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ABSTRACT 


Human error is a significant contributing factor in a very high pro- 
portion of civil transport, general aviation, and rotorcraft accidents. 
Finding ways to reduce the number and severity of human errors would thus 
appear to offer promise for a significant Improvement in aviation 
safety. Human errors in aviation tend to be treated in terms of clinical 
and anecdotal descriptions, however, from which remedial measures are 
difficult to derive. Correction of the sources of human error requires 
that one attempt to reconstruct underlying and contributing causes of 
error from the circumstantial causes cited in official investigative 
reports. Relevant measurements based on a comprehensive analytical theory 
of the cause-effect relationships governing propagation of human error are 
Indispensable to a reconstruction of the underlying and contributing 
causes. At present there is no national capability to Implement the part- 
or full-mission flight simulation studies which are necessary to support 
the relevant measurements in the context of the national airspace 
system. NASA Ames Research Center has therefore proposed the Man-Vehicle 
Systems Research Facility to support the flight simulation studies which 
are needed for identifying and correcting the sources of human error asso- 
ciated with current and future air carrier operations. This report 
reviews the proposed organization of the Man- Vehicle Systems Research 
Facility and recommends functional requirements and related priorities for 
the facility based on a review of potentially critical operational 
scenarios. Requirements are included for the experimenter's simulation 
control and data acquisition functions, as well as for the visual field, 
motion, sound, computation, crew station, and intercommunications sub- 
systems. The related Issues of functional fidelity and level of 
simulation are addressed, and specific criteria for quantitative assess- 
ment of various aspects of fidelity are offered. The report concludes 
with recommendations for facility Integration, checkout, and staffing. 
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SECTION I 


INTRODUCTION 


Findings by the Flight Safety Foundation, the National Transportation 
Safety Board, and others indicate that human error is at least a major 
contributing factor in a very high proportion (80 percent or more) of 
civil transport, general aviation, and rotorcraft accidents. Finding ways 
to reduce the number and severity of human errors would thus appear to 
offer great promise for a significant reduction in accidents and improve- 
ments in aviation safety. 

The proportional Involvement of human errors in aviation accidents has 
been relatively stable in spite of many changes in the air traffic control 
system and typical cockpits. This does not necessarily mean that an ir- 
reducible minimum has been reached, however. Instead we appear to be on a 
plateau in understanding the quantitative details of just how the human 
elements contribute. To make a significant dent in error reduction re- 
quires a better appreciation for the sources and causes of human errors as 
they affect the total aeronautical transportation system structure. 

Human errors in aviation tend to be treated in terms of clinical and 
anecdotal descriptions, however. For a more concrete identification of 
the sources^ of human error, one must strive to separate original under- 
lying and contributing causes from the circumstantial causes cited in 
official investigative reports. Furthermore, if one is to attempt cor- 
rection of the sources of human error, their cause-effect relationships 
must be better quantified and classified. 

Meaningful quantification and classification requires a sound under- 
lying and unifying foundation in terms of mathematical models which sub- 
sume existing evidence, permit the planning of experimental measurements, 
guide the interpretation of results, and serve as the basis for extrapo- 
lation of results to other circumstances. Reference 1 was prepared to 
fulfill this need for a sound foundation. 
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Based on* the foundation In Ref. 1, Ref. 2 discussed the technical 
details of a variety of approaches for the measurement of human errors In 
the context of the national airspace system with primary emphasis on cock- 
pit operations and procedures In part- or full-mission simulation. As one 
means to this end the National Aeronautics and Space Administration Is 
planning a new Man Vehicle Systems Research Facility (MVSRF) for Ames 
Research Center. Recommended functional requirements and related priori- 
ties for the MVSRF are the subjects of this report. 

A. REVIEW OF MVSRF REQUIREMENTS (REF* 3) 

At present there Is no national capability to support the flight simu- 
lation studies which are necessary for identifying and correcting the 
sources of human error associated with current and future air carrier 

it 

operations . The Han Vehicle Systems Research Facility is intended to 
address at least three Issues requiring high operational fidelity in avia- 
tion safety research: 

1. Full mission/full crew/multi-aircraft/air traffic 
control (ATC) interactions in general, 

2. Crew/avionics, crew/crew, and crew/ATC Interactions 
which are design specific, and 

3. Advanced technology cockpits and man-machine 
relationships therein. 

Major investigations of these Issues will have as basic purposes the en- 
hancement of flight safety and improved performance in essence the 

reduction of human error. 

Meeting these overall objectives will require research on critical 
human factors Issues that are Involved in: 


* A national facility survey is provided in Ref. 4. 
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1* Development of fundamental analytical expressions of the 
functional performance characteristics of both the air- 
crew and ground crew; 

2. Formulation of design criteria and principles, from the 
human factors perspective, appropriate to flight systems 
and operational environments of the future; 

3. Integration of new subsystems and procedures such as 
electronic displays and automated avionics and controls 
Into contemporary flight and traffic control scenarios; 
and 

4> New training technologies that will be required by the 
continued technical evolution of flight systems and the 
operational environment. 

The MVSRF will consist of two commercial transport aircraft cockpits 
designed to accommodate pilot, copilot, flight engineer, and observer. 
Although each cockpit will be on a fixed base, provision for the future 
Incorporation of motion bases will be considered. The facility will also 
Include a functional terminal area ATC capability and an Interactive 
computer-generated external visual scene for each cockpit. These 
principal system components will provide a high degree of fidelity with 
particular attention being devoted to the human factors aspects of the 
simulations. One cockpit will be a fully functional representation of a 
contemporary commercial transport aircraft flight deck; It will be called 
the current technology flight deck. The other cockpit will be provided 
with a programmable array of all-electronic computer-generated display 
systems In place of the usual complement of electromechanical displays. 
This second cockpit may be configured to represent flight decks of future 
aircraft; It will be called the advanced technology flight deck. 

Important aspects of the simulation facility will be: Independent 
simultaneous operation of both cockpits In the same air space; provision 
of navigation and communication signals; two or more Interacting aircraft; 
weather effects; sound effects; and the capability for Initiating, moni- 
toring, and controlling various system malfunctions and failures all 

with a high degree of operational fidelity. A computer laboratory for 
overall control of the simulation, solution of the aerodynamic equations. 
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simulation of the effects of malfunctions and failures of aircraft sys- 
tems, and collection and systematic analysis of simulation and performance 
data will be included within a new building to house the facility at Ames 
Research Center. 

B. FUNCTIONAL ORGANIZATION OF THE FACILITY 

Figure 1 portrays the overall functional organization of the MVSRF as 

defined in Ref. 3 and updated in Ref. 5. There are three main functional 

subdivisions within the facility, viz. , the current technology flight 
simulation (shown at the left side of Fig. 1), the air traffic control 

simulation (shown in the center of Fig. 1), and the advanced technology 

flight simulation (shown at the right side of Fig. 1). More details of 
each of these functional subdivisions will be shown subsequently in 
Figs. 2, 3, and 4 adapted from Ref. 5. 

Two host digital computers are planned to solve equations of motion 
for each of the flight simulations, to model avionics and aircraft 
systems, to provide computer-generated scenes and displays, to Implement 
data collection, to control input/output operations among the facility 
subsystems, and, in general, to control each independent simulation. A 
separate digital computer is planned to perform simulation for the air 
traffic control function. A program development capability is also 
planned together with sufficient hardware and software communications to 
Interconnect all computation system components. 

System software will be required to support high level and assembly 
level language processing as well as program editing and debugging. A 
nominal set of program modules will also be required for each simula- 
tion. The set of program modules will Include flexible aerodynamic 

models, as well as driver modules, for each of the facility subsystems 
under control by the simulation computer(s). 

Having completed this overall view of the facility organization in 
Fig. 1, we shall now examine more details of the current technology flight 
simulation requirements. 
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Refer to Fig. 2 for more 
details of the Current 
Technology Simulation 


Figure 1. Overall Functional Organization of the 
Man-Vehicle Systems Research Facility (MVSRF) 
(Adapted from Ref. 5) 


Refer to Fig. 4 for more 
Details of the Advanced 
Technology Simulation 





!• Current Technology Simulation (Fig. 2) 


a* Flight Deck and Aircraft . The stated purpose of the facility is 
to reproduce with high operational fidelity all of the mission functions 
perceived and performed by each crew member throughout normal and abnormal 
flight profiles. Phases of the flight profile to be simulated include: 
filing of flight plans, preflight checkout, taxi, takeoff, climb, cruise, 
descent, holding, approach, landing, and final roll-out on the runway. 
This stated purpose does not necessarily mean that the facility must imi- 
tate all of the equipment involved. Nevertheless, as in the training 
community, the Identical elements theory of Thorndike will likely be in- 
voked for the current technology flight deck and the various mathematical 
models of the physical functions involved in the flight simulation. This 
is because of the importance (for studying the causes of human error) 
which is vested in the capability for initiating, monitoring, and control- 
ling various flight and ATC system malfvmctions and failures in the 
MVSRF. Reverse transfer of training (from flight experience to the MVSRF) 
is thus very important among flight crew members who will participate in 
full mission simulations. Reverse transfer is believed to be assured by 
providing a current technology flight deck which is functionally Identical 
to that in a contemporary jet transport with which a significant portion 
of the airline pilot population has experience. 

Likewise, because of the Importance attached to studying the causes of 
human error, access to "initial condition," "hold," or "reset" control 
over the simulation should not be provided within the flight deck, thereby 
denying to the crew one means for concealing human error in the simulator. 

Shown at the top of Fig. 2 is the current technology simulator host 
computer in which mathematical models of the aircraft and its flight sys- 
tem functions will be programmed. Table 1 lists the principal functions 
which are recommended for simulation in current technology host computer. 

Figure 2 also shows the relationships among the host computer, the 
current technology flight deck, and the experimenters’ control console via 
the Input/output (I/O) subsystem and its satellite computer. References 3 
and 5 have made preliminary estimates of the I/O subsystem requirements to 
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TABLE 1 


FUNCTIONS RECOMMENDED FOR THE CURRENT TECHNOLOGY 
FLIGHT SIMULATION OF A COMMERCIAL TRANSPORT 

(Adapted from Ref. 5) 


A. Airframe Kinematics, Aerodynamics, and Propulsion Dynamics 

Mathematical models throughout flight profile, including ground 
taxi, takeoff, landing, and roll-out 
External visual scene generation outputs, including provision for 
head-up display outputs 
Instrument outputs 
Flight control loader outputs 
Flight and propulsion control Inputs 
Configuration control Inputs 
Steering and braking control inputs 

B. Aircraft System Operations 

Altitude transponder 

Air conditioning and pressurization (environmental) 

Air data 

Automatic flight 
Auxiliary power unit 
Braking 

Caution advisory 
Communications 
Electrical 
Engine Instruments 
Fire protection 
Flight control 
Flight Instruments 
Flight management 
Fuel 

Hydraulic 

Ice and rain protection 
Landing gear 

Navigation, including landing guidance 

Nose wheel steering 

Pneumatic 

Propulsion and control thereof 
Sound, including aural warning advisory 
Warning advisory, visual 

Weather radar (requires graphics display planned only for advanced 
technology simulation) 
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accommodate the large number of switches. Indicators, instruments, and 
controls in the current technology flight deck exclusive of most circuit 
breakers* Total estimated requirements from Ref* 5 are shown in 
Table 2* The directions "in” and ”out” in Table 2 are to be interpreted 
with respect to the I/O subsystem computer in Fig* 2* Only 32 bits of the 
discrete channel requirements are devoted to circuit breakers* 

b* Experimenters* Control Console and Data Acquisition * This station 
will provide for set up, checkout, monitoring, and control of the simula- 
tion by means of status and performance data displays, selected instrument 
repeaters, closed-circuit video repeaters, computer terminals, and pro- 
grammable multifunction touch panels and keyboards* 

It should be possible for the experimenter to introduce failures of 
the major aircraft systems independently in each simulation* Specific 
mode and timing of the failures should be at the descretion of the experi- 
menter* Routine access to all simulation variables should be provided 
while in operation* 

It should likewise be possible to record digitally all data descrip- 
tive of the simulated flight envelope and aircraft system functions for an 
entire aircraft mission as well as selected subsets of crew procedures and 
behavioral data* Means should also be provided to retrieve and display 
selected channels of data, either for previously stored data or in real 
time* Archival data recording options should include hard copy, strip 
charts, and magnetic tape. Provision should be made to record routinely a 
full range of simulation variables without special operator actions such 
as manually loading tape decks while the experiment is in progress. The 
data to be recorded should be selectable in advance from the experi- 
menters* terminals* Technical approaches for the measurement of human 
errors are discussed in depth in Ref* 2* 

Three additional functional capabilities are shown in Fig* 2, viz*, 
the external visual scene generation, sound generation, and voice inter- 
communication subsystems. Excerpts of the functional descriptions of 
these three subsystems follow from Ref* 3* 
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TABLE 2 


NUMBER AND TYPE OF SIGNALS FOR THE MVSRF I/O SUBSYSTEM (From Ref. 5) 


Type of Signal 

Current Technology 
Flight Simulation 

Advanced Technology 
Flight Simulation 

Total* * * § 


Flight Deck 

Othert 


Others 


Analog Out (DAC) 

To Plight Deck 
240 

58 

13 

22 

333 

Analog In (ADC) 

From Flight Deck 
40 

15 

37 

0 

92 

Discrete and 
Digital In (Bits) 

From Flight Deck 
945 

(32 are circuit breakers) 

61 

385 

35 

1426 bits 

Discrete and 
Digital Out (bits) 

To Flight Deck 
553 

(32 are circuit breakers) 

155 

188 

98 

994 

Synchro In 

From Flight Deck 
6 

0 

0 

0 

6 

Synchro Out 

To Flight Deck 
10 

8 

0 

0 

18 , 


* Both flight decks can be run simultaneously If all I/O signals between flight decks and host computers are 
Independent. 

t Includes control loader^ sound subsystem^ experimenter's control console, and provisions for motion base 

drive signals. 

§ Includes sound subsystem, experimenter's control console, and provisions for motion base drive signals. 












c. VI sml . Scene (From Ref« 3) « "The scene generator will be a com- 
puter generated Image (CGI) system. It will store a data base consisting 
of, at minimum, two terminal areas and a representation of enroute visual 
conditions so that complete aircraft missions may be simulated, including 
roll-out and taxi and the final approach and landing. The scene generator 
should be capable of generating other aircraft In the visual field and a 
variety of visual weather types, ceilings, and reduced visibility condi- 
tions. It should have the growth capability of displaying textured 
surfaces as well as points of lights, so that the visual conditions of 
night, dusk, and eventually day may be recreated. Several levels of 
visual occlusion should eventually be provided so that three-dimensional 
structures may visually block one another, an Important element in visual 
depth perception and in producing a realistic visual illusion. 

"Two display systems will be provided, one for each of the simulator 
cabs. Each system will consist of two cathode ray tubes (CRT) with colli- 
mating optic units, mounted in front of the pilot's and first officer's 
seats. Each display unit will provide a 45 deg wide by 35 deg high field 
of view and a virtual image at optical infinity. It is anticipated that 
specific research projects in the future may require additional fleld-of- 
vlew capability, e.g. , side window views for traffic detection, collision 
avoidance, and complex or curved approaches. For this reason, an impor- 
tant capability of the visual system is that of modularity; it must be 
possible to augment the basic system in the future to provide more visual 
channels." (Ref. 3) 

d. Cockpit Interior Sound Generation System (From Ref. 3) . "It is 
Intended that the cockpit noise generation systems meet the requirements 
of both high fidelity and flexibility. Sounds from a variety of sources 
within and outside the aircraft will be provided: slipstream noise, the 
noise of each turbofan engine, including jet and turbomachinery noise, air 
conditioning noise, landing gear actuator, auxiliary power unit (AFU) and 
other hydraulic system noise, runway rumble noise, and aural warning 
sounds. Sufficient flexibility will be provided in the noise generation 
systems such that the characteristic sound of engine and other system 
malfunctions may be reproduced for the flight crew. 
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'*5oth discrete and analog signals from the host computer systems will 
be required to provide these sound generation systems with the appropriate 
aircraft parameters. For e^cample, slipstream noise varies with airspeed 
and turboban engine noise varies continuously as a function of engine rpm 
and thrust level. These signals will be of the analog variety. As many 
as 15 separate aural warning signals are provided in current technology 
transport aircraft cockpits. These sounds are typically acoustically 
simple: tones» horns» buzzers, etc. These aural warnings, landing gear 
actuation, and other transient or intermittent noises will be controlled 
by discrete signals from the computer I/O systems. The overall volume 
level in each cockpit will be controllable from the experimenter’s con- 
sole.- (Ref. 3) 

e. Voice Intercom (From Ref. 3) . "The voice intercom system will 
provide flexible multi-channel voice communications for the various per- 
sonnel involved in the simulation. Communication stations include 
aircraft simulator flight decks, ATC simulators, simulation operation, and 
experimenters’ control, together with automatic Interconnection for simu- 
lated navigation aids and weather information. 

"In the simulator flight decks, the intercom system will be designed 
to simulate radio links for such functions as air traffic control sectors, 
navigation aids, and weather information. To the pilots It will appear 
that they are selecting radio frequencies on transceivers for communica- 
tions with the various ground facilities* 

"Navigation aids and weather information will be recorded on updatable 
endless log tape recorders. The pilots will be connected to these record- 
ings when they select the proper frequencies. 

"The ATC simulator will have stations for air traffic controllers, 
pseudo-pilots, and experimenters. The voice Intercom for the air traffic 
controllers will be designed to operate in a manner similar to actual ATC 
installations. 
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"The experimenters and simulator operators will be able to monitor. 
Intervene, and control the voice Intercom. A multi-channel audio tape 
recorder will also be connected to the system so that a permanent record 
of the audio part of the simulation can be made." (Ref. 3) 

This concludes a review of functional requirements for the current 
technology simulation. In the next topic we shall outline functional 
requirements for the air traffic control simulation. 

2. Air Traffic Control Simulation (Fig. 3) 

Within the context of full-mission simulation experiments Involving 
commercial transports, one of the essential Ingredients Is simulation of 
Interacting air traffic and the necessary communications with the respons- 
ible air traffic controllers. Ames Research Center has an operational ATC 
simulation facility which has been connected via telephone link to FAA 
NAFEC simulations. Although the ATC display processor, the ATC visual 
display-audio communication Interfaces, and the pseudo-pilot audio-control 
interfaces exist at Ames Research Center as shown In Fig. 3 within the 
( ~) symbols, the facility lacks a dedicated host computer system 

(center of Fig. 3) which is needed for long-duration full-mission simu- 
lation. Consequently the MVSRF design group has Invited the M.I.T. Flight 
Transportation Laboratory to recommend functional requirements for an 
independent ATC simulation facility which is capable of servicing full 
mission simulation. The results are given In Fig. 3, together with the 
list of requirements In Table 3. 

The advantages of this approach (from Ref. 3) are three-fold: (a) 

some of the projected ATC experiments can be conducted Independently of 
the MVSRF, (b) traffic generation software developed Independently for ATC 
studies can be Incorporated In full-mission simulation experiments, and 
(c) the traffic generation function Itself, which can be computation- 
intensive, will not compete for computation resources within either the 
current or advanced technology simulation hosts. The ATC simulation fa- 
cility will not be discussed further In this report. 
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TABLE 3 


FUNCTIONS RECOMMENDED FOR THE AIR TRAFFIC CONTROL SYSTEM 
SIMULATION IN THE MVSRF 

(From Ref. 5) 


• Generate Pseudo-aircraft at prespecified points and time 

• Provide controllers with information needed to control 
traffic 

• Provide control via voice or data link communication to 
piloted and pseudo-aircraft 

• Allow pseudo-pilots to navigate pseudo-aircraft via keyboard 
entry 

• Generate aircraft and piloted aircraft positions as a 

function of: Commands, aircraft dynamics, and wind 

environment 

o Generate ground track data on pseudo- and piloted aircraft 
positions as perceived by surveillance radar 

• Provide host computers of piloted simulators xd.th traffic 
data required to drive onboard traffic displays and visual 
scene 

• Manage and distribute available ATC information (ATIS, 
weather) via voice and/or digital datalink 

• D 3 mamically change ATC sectors (airspace, navalds, pseudo- 
traffic) according to script and position of piloted aircraft 

• Collect performance statistics for on-line processing and 
display 

• Perform advanced ATC management fimctlons: runway 

scheduling, flight path generation, collision avoidance, and 
resolution. 
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In the next topic we shall examine functional requirements for the 
advanced technology flight simulation. 

3. Advanced Technology Sinulation (Fig. 4) 

The advanced technology simulation, by definition, can be liberated 
from following the precepts vested in the identical elements theory of 
Thorndike. The cost of ^liberation" will inevitably be more substantial 
flight crew training requirements for full-mission simulations employing 
advanced technology. Our experience in Ref. 6 reflected substantial 
training requirements even for part-mission simulation, and the MVSRF 
experimental planning workshop also recognized this fact in Ref. 7. 

Shown at the top of Fig. 4 is the advanced technology simulator host 
computer in which mathematical models of the aircraft and its flight sys- 
tem functions will be programmed. Table 4 lists the principal functions 
which are recommended for simulation in the advanced technology host com- 
puter. 

Figure 4 also shows the relationships among the host computer, the 
advanced technology flight deck, and the experimenters* control console 
via the input/output (I/O) subsystem and its satellite computer. 
Reference 5 has made preliminary estimates of the I/O subsystem require- 
ments to accommodate the advanced technology flight deck exclusive of most 
circuit breakers. Total estimated requirements from Ref. 5 are shown in 
Table 2. The I/O requirements for the advanced technology simulation are 
reduced by virtue of the substitution of computer-graphics in place of the 
large number of Individiial switches, indicators, instruments, and controls 
in the current technology simulation. 

a. Flight Deck. Excepting the head-up display, all primary flight, 
navigation, aircraft system, and status advisory displays will be gen- 
erated on flat panel displays or cathode ray displays by a computer- 
graphics systems shown in Fig. 4. The configuration and content of these 
primary displays will be varied from one experiment to another. Typical 
examples of display layout and content may be found in Refs. 5 and 8. 
Flight management, command, actuation, status, and advisory information 
will be generated and presented in this manner. 


TR-1 156-3 


16 



TR- 1156-3 



GRAPHICS 

REPEATERS 


EXPERIMENTERS' 
CONTROL CONSOLE 


1/0 SYSTEM 


SOUND 

SYSTEM 


VOICE AND 
INTERCOM 


--•^Audlo to/froo 
ATC Communication 
Switch, Fig. 3 


Figure 4. Functional Organization 
of the Advanced Technology 
Simulation in the MVSRF (Adapted 
from Ref. 5) 















TABLE 4 


FUNCTIONS RECOMMENDED FOR THE ADVANCED TECHNOLOGY FLIGHT SIMULATION 

OF A COMMERCIAL TRANSPORT 

(Adapted from Ref. 5) 


A. Airframe Kinematics, Aerodynamics, and Propulsion Dynamics 

Mathematical models throughout flight profile, including ground 
taxi, takeoff, landing, and roll-out 
External visual scene generation outputs. Including head-up 
display outputs 

Primary flight display outputs (EADI) 

Integrated navigation display outputs (EHSI) 

Status advisory display outputs from aircraft 
system operations 
Primary engine display outputs 
Control surface display outputs 
Control display unit Inputs/outputs 
Flight control loader outputs 
Flight and propulsion control Inputs 
Configuration control Inputs 
Steering and braking control inputs 

B. Aircraft System Operations 

Air conditioning and pressurization (environmental) 

Air data 

Automatic flight 
Auxiliary power unit 
Braking 

Collision avoidance 
Commimlcat ions 
Voice 
Data link 
Electrical 
Fire protection 

Flight control. Including stability and control augmentation 

Flight management 

Fuel 

Hydraulic 

Ice and rain protection 
Landing gear 

Monitoring, alerting, and warning (including caution advisory) 
Integrated navigation and guidance 
Nose wheel steering 
Pneumatic 

Propulsion and control thereof 
Sound, including aural warning advisory 
Weather radar 


Outputs for 

Graphics 

System 
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b. Experimenters* Control Console and Data Acquisition , These func- 
tions will be similar to those described previously for the current 
technology simulation, except that instrument repeaters will no longer be 
required, since video repeaters will accommodate all displays as well as 
the external visual scene. 

Three additional functional capabilities are shown In Fig. 4, viz., 
the external visual scene generation (including the head-up display 

graphics), sound generation, and voice Intercom subsystems. The func- 
tional descriptions of these subsystems remain substantially the same as 
described previously for the current technology simulation. 

c. Visual Scene. The head-up display graphics will be added, and the 

field of view of the external visual scene will be increased to accon- 
modate visual traffic detection and collision avoidance experiments 
outside the forward "tunnel** field of view provided In the current 

technology simulation. 

d. Cockpit Interior Sound Generation (From Ref. 3) . "Cockpit 

alerting and warning system research will comprise an important area of 
utilization for this advanced facility. Consequently, it is reqxiired that 
a subsystem be provided which can Introduce both spoken and coded warning 
signals Into either the advanced technology cockpits upon command from the 
host computer system. Otherwise the cockpit Interior sound generation 

function will be similar to that described previously for the current 

technology simulation. 

e. Voice Intercom. This function will be similar to that described 
previously for the current technology simulation. 


This concludes our introduction to the fimctional organization of the 
MVSRF. From this introduction it should be clear that careful planning by 
NASA has evolved the functional organization to an advanced state of 
readiness for more detailed investigation of subsystem functional require- 
ments in the light of critical operational scenarios, to which we turn 
next. 
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C. CRITICAL OPERATIONAL SCENARIOS 


An essential prerequisite to recommendation of more specific subsystem 
functional requirements for the MVSRF is a thorough review of the antici- 
pated needs. Our primary method for accomplishing and summarizing this 
has been to prepare a table of critical operational sltxiations requiring 
investigation of causes of human error. The result is given in Table 5, 
which lists flight phases and piloting tasks required for both conven- 
tional commercial, and STOL transport aircraft. 

The mission phases for both types of aircraft emphasize the criti- 
cality of terminal and near-terminal operations wherein both piloting and 
air traffic control procedures are prone to human error. Normal cruising 
flight also involves climbing, rough air disturbance regulation, and 
descent procedures which may ^ vulnerable to crew complacency induced by 
automation. Finally several emergencies are listed which merit further 
investigation with an element of surprise. This last use of the MVSRF is 
most important and constitutes some of the most demanding situations in 
several respects. We have enclosed certain cells of Table 5 xiithln bold 
outline to emphasize their criticality from the standpoint of their impact 
on the functional requirements of the simulation. 

After reviewing Table 5, attaching weighting factors to the importance 
of the aforementioned phases and tasks, and considering the various simu- 
lation elements (i.e., the computer, instruments/displays, visual, motion, 
and control systems) we have listed in Table 6 several critical opera- 
tional scenarios which emerged to constrain the design of these simulation 
elements. The "critical requirements and remarks" column represents a 
concise summary of some of the issues to be discussed in the subsequent 
sections of this report. 
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TABLE 5 


CRITICAL OPERATIONAL SITUATIONS REQUIRING SIMULATION 
FOR THE PURPOSE OF INVESTIGATING HUMAN ERROR 




Transport Aircraft 

Flight 

Phases 

Piloting 

Task 

CTOL 

STOL 


Takeoff 

Lift-off and rotation; engine 
out 

Maximum power jump; engine out 


Landing 



Terminal 

Operations 

Beam Acquisition 

Beam Overshoots 

ATC Procedures; curved 
approaches 

Approach 

ICAO Cat. II, VFR; IFR III; 
DLC; ETA Control 

Curved approach; VFR, IFR; 
Steep descent; DLC, TVC* 


Breakout and flare 

ATC procedures 

ICAO Cat III; DLC, TVC 


Decrab (touchdown) rollout 

ICAO Cat. Ill 

Crosswinds 


Taxi and docking 

ICAO Cat. I1I-B,C 

ICAO Cat. m-B,C 


Co around 

Energy management; VFR, IFR 
Procedures 

Energy management; VFR, IFR 
Procedures 


Close-in navigation 

IFR and ATC procedures; 
traffic detection 

IFR and ATC procedures; 
traffic detection, curved'' 
course, steep descent 

Near 

Terminal 

Operations 

Noise abatement or minimum 
exposure 

Steep turns, minimum noise 
takeoffs 

Curved course, steep descent, 
minimum noise 

Holding 

ATC procedures; FAA holding 
pattern in wind; fuel dump 

ATC procedures; FAA holding 
pattern in wind; configuration 
change; engine out 


Climb 

FAA noise profile 

FAA noise profile, curved 
course 

Normal 

Cruising 

Flight 

Cruise 

ATC procedures; automation 
crew complacency; crew 
fatigue; energy management; 
altitude control; course 
control; waypoint overshoots; 
RNAV 

ATC procedures; automation 
crew complacency; crew 
fatigue; energy management; 
altitude control; course 
control; waypoint overshoots; 
RNAV 


Rough air disturbance 
regulation 

C.A.T; gust upset; wind shear 

Gust upset; wind shear 


Descent 

TOD overshoots; (see Hi-q 
and/or Hi Mach) 

TOD overshoots; (see Hl-q 
and/or Hi Mach) 


Rl-q and/or Hi Kach 

Fast descent (tuck); PIO; 
engine out 

Fast descent (tuck); PIO; 
engine out 


Engine-out management 

Asymmetric conditions; 
takeoff; low speed; hl-q 

Asymmetric conditions; 
takeoff; low speed; hi-q 


AFCS failures management 

Hardover 

Hardover 

Energcncles 

Damage management 

Collision; structural failure; 
fire 

Collision; structural failure; 
fire 


Aircraft/ATC system failure 
management 

Distraction from flight 
management in any phase 

Distraction from flight 
management in any phase 


Collision avoidance 

VFR; IFR; ATC procedures; 
response to warning; evasive 
maneuvers; structural failure; 
aerodynamic stall 

VFR; IFR; ATC procedures; 
response to warning; evasive 
maneuvers; structural failure; 
aerodynamic stall 


* Conf iguraclon change; ETA control; engine out. 
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SOME CRITICAL OPERATIONAL 
CONSTRAIN THE DESIGN OF 


SITUATIONS WHICH WILL 
SIMULATION ELEMENTS 


Critical Oparaclonal 
Situations 

Constrain These 
Siaulation 
ElesMots 

Critical Requirements and Remarics 

’Full Mission 
Simula tlon** 

Computer: 

Kinematics and guidance calculations over long ranges and times* 
Time* Varying aircraft trim, coefficients, and controls; A 00F« 
Failure effects in all aircraft systems. 


Inatruments/ 
Displays t 

Realistic and complete inatniment, avionics, and navaid complex for 
all crew members. 

ICAO Categories IX 
and XII Landing and 
Terminal Operations 

Computer: 

Instruments: 

Traffic generation and air traffic control simulation; collision 
avoidance. Failure effects in all aircraft systems. 

Use of BUD or HDD simultaneously with instruments. Realistic 
Category XI and III instnxment, avionics, and navaid complex for all 
crew members. 


Auditory Cues: 

Engine whine and aero noise affect throttle handling. 


External View: 

High acuity view of approach and runway; fog simulation. Modest 
field of view (d; 23 deg okay). Visual scene response delay > 

40 msec may compromise fidelity in takeoff, breakout flare, decrab, 
rollout, taxi, and docking. Very smooth presentations required. 

VFR Teminal Area 

External View: 

High acuity wide field needed for traffic detection; cloud 
siaulation. 

VFR Approaches 

Motion Cues: 

Gust induced motion cues are important for compensatory 
regulation. Frequency response critical; travels can be modest via 
attenuated inputs or by shaping input to dominant frequency region. 

Engine Failures; 
Bardover Control 
Failures; AarodFoamie 
Stall 

Motion Cues: 

Alerting cues are important; coablnation of rotary and linear* 
Travel versus washout depends on cue duration. Buffeting cues are 
important (stall margins). 

STOl. Maneuvers (e«g.» 
curved approaches, 
steep descents, 
erosswlnd landing, 
transition oaneuvers) 

Computer: 
External View: 

Time* and conf iguratioT^varylng, 6*D0F, coupled, NL aerodynsmlcs; 
'^inertial (landing into steady wind) 

Complex terrain features required for height and direction cues. 
Large field of view required (± 45 deg; more if 0). 

High acuity is desirable in foveal region; parafoveal tield can be 
crude. Large rotation and crab angles with respect to line*of*slght 
or path. 

, 

Pilot's Controls: 

New piloting techniques require diverse nix of primary controls 
(e.g., thrust vector) 
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D. ORGANIZATION OF THE REPORT 


Section II attempts to clarify the notion of functional fidelity as it 
applies to flight simulation and concludes with suggested criteria for 
fidelity of some of the elements with which we are concerned. Particu- 
larly in the cases of the visual field and motion systems, the criteria 
are deficient and merit considerable research, per se. 

Section III discusses visual field simulation and Section IV, motion 
cue simulation. Section V treats the vehicle and environment 2 il models, 
and Section VI, computational considerations. Section VII offers recom- 
mendations for organization of the software, based on our experience. 
Section VIII addresses crew stations and Section IX, the experimenter's 
console. Section X offers some suggestions for facility integration, 
checkout, scheduling, operation, and staffing. Section XI presents con- 
clusions and recommendations and is followed by the list of references and 
supporting appendices. 
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SECTION II 


FUNCTIONAL FIDELITY 


A. DEFINITIONS 

1. Understanding «hat Is Meant by Fidelity 
and Validity 

Simulators are already used In flight research and training for three 
main reasons: 

• Simulators involve lower costs to buy and operate than 
an aircraft 

• One can safely expose untrained subjects to potentially 
dangerous situations 

• One can control the variables and measure the results 

easier In a simulator than In the real environment. 

All such applications presuppose that there is a positive transfer of 
training between the simulator and the "real-world" situation when the 
"fidelity" of the simulation subsystem and the "validity" of the simu- 

lation become "adequate" in some sense. Reference 9 has discussed these 
Issues In depth. Whereas the validity Issue addresses directly the trans- 
ferability of simulator results to the flight situation, the fidelity 

issue addresses the adequacy of perceptual effects and their consequent 
pilot responses Induced by the simulator as a result of, for example, 

cockpit (crew station), visual, motion, aural, and computation subsystem 
engineering and construction. "If minimum fidelity requirements are not 
met for economic reasons, the validity of the total simulation may be 
jeopardized. In this sense, the two Issues are Interrelated, and the 
burden of proof falls on the research community to justify necessary im- 
provements in fidelity which stem from established requirements in 
validity. The fundamental problem Is to assess the extent to which sub- 
system engineering Improvements promote Increased psychological (including 
psychomotor) realism." (Ref. 9) 
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We shall begin by considering some ideas about simulator fidelity 
which are useful for our purposes. Reference 10 presents a discussion of 
fidelity which distinguishes two main "types" of fidelity: objective 
fidelity and perceptual fidelity. 

Objective fidelity (or in Ref. 11, engineering fidelity) is the degree 
to which the simulator reproduces measurable aircraft states or condi- 
tions. To ensure perfect objective fidelity, elaborate mathematical 
models of aircraft are frequently developed using actual wind tunnel data, 
detailed flight control system diagrams, replication of aircraft cockpits 
and control feel systems, and anything else affordable which may be re- 
garded as the last word in definition of the actual aircraft. In striving 
for visual field fidelity, the training simulation community has usually 
tried to describe (and to specify) the engineering fidelity of a visual 
simulator subsystem in terms of the functional attributes in Table 7. In 
terms of motion fidelity, perfect objective fidelity would correspond to a 
one-to-one duplication of inertial-based displacements, velocities, and 
accelerations in each axis of freedom, a limit of perfection which only 
total in-flight simulation can achieve. 

Unfortunately, methodologies have not been developed to determine with 
high confidence the interactive influence of (simulator) subsystem 
engineering fidelity on overall (simulator) system validity as it has been 
defined. Recently such methodologies have undergone more careful scrutiny 
and some attempts have been made (notably at the University of Illinois, 
Institute of Aviation) to establish the validity of various ground-based 
flight simulators. The results are partially consistent and somewhat 
controversial, but generally support the well-proven fact that when all 
procedures, all aspects of the environment, and all cues are correct, then 
good training results. The problem remains to quantify how far the cues 
can deviate from reality and still provide cost-effective simulation for 
the MVSRF. 

Perceptual fidelity is the degree to which subjects perceive the simu- 
lator to duplicate aircraft states or conditions. This type of fidelity 
is subject-centered and Includes both psychological and physiological 
effects. We shall not, however, concede that perceptual fidelity is 
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TABLE 7 


FUNCTIONAL ATTRIBUTES OF A VISUAL SIMULATOR 


Field of view 

Elevation 

Azimuth 

Image quality and fidelity 

Static resolution ) dependence oh field of view and 
Dynamic resolution / requirement for overlapping fields 
Depth of field ) 

Brightness 

Contrast — monochromatic versus color 

Scene content — essential and desirable 

Recognition thresholds for pattern information in detail and texture 
Form, size, inclination, expansion, and rotation thresholds for 
acceleration, velocity, and displacement control inforaation 
Special effects — heterogeneous fog, clouds, sea spray, dust 
Art if leal cues 

Peripheral visual displays 

Independent synthetic landing monitor displays in a head-up 
format 

g-seats and g-suits 

Image generation techniques 

Scale models with movable television camera 
C omput e r-gene ra t ed 
Calligraphic 
Raster graphic 

Electronically-generated calligraphic 

Cinematographic 

Point-light source 

Image presentation technique 

Real — screen shape, viewing distance, front or rear projection 
Virtual — exit pupil size, shape, hyperfocal distance, binocular 
disparity 

Movement performance 

Rotational J acceleration, velocity, and displacement 

Translational / extrema and thresholds 

Dynamic errors / 

Jitter ^ 

Flicker 

Update rate or visual lag 
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either unmeasurable or unquantlflable* In fact, we shall offer some 
recommendations, based largely upon Ref* 2, for ultimately quantifying 
percep tual ef f e ct s • 

To the extent that the human operator's perception can be explained in 
rational terms, it is possible to merge the ideas of objective and percep- 
tual fidelity* For example, since the human vestibular system can be 
described in terms of effective washouts, lags, and thresholds, then it is 
possible to apply the same objective metrics as one does to a mechanical 
motion base platform, an electrical network, or an airplane equation of 
motion* 

Another aspect of fidelity which needs to be addressed is that of 
induced pilot behavior* Reference 12 defines simulator fidelity as the 
adequacy of perceptual effects and their consequent pilot response be- 
havior induced by the simulator* Furthermore, this behavior must be 
qualified by a specified task environment* The issue of behavior is, of 
course, central to learning and skill development* If the simulator can- 
not induce correct behavior, then its role in training is questionable* 
At the very least, failure of a simulator to induce certain features of 
correct behavior in a specific task environment should be duly noted. 

2m An Operational Definition of Fidelity 

We have arrived at a point at which it is possible to set forth a 
general definition of simulator fidelity which takes advantage of our 
growing knowledge of the pilot's perceptual mechanisms and induced be- 
havior, the dynamics of the simulator components (electro-mechanical and 
electronic), and the specific flight tasks of interest* 

Note that the means of viewing the simulator and the pilot, which is 
described above, allows for extensive but direct quantification* Our 
objective regarding fidelity is to establish a working definition which 
takes full advantage of such quantification. 
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Consider also that training Is the development and refinement of a 

suitable control loop structure the specific means by which a task Is 

carried out. Further, training Involves the reliance upon perceptual 
mechanisms appropriate to the given task. 

Therefore an appealing approach to simulator fidelity is to focus on 
how the pilot carries out a particular task given the perception (or in- 
ferred perception) of necessary cues. Hence we would construct a qtiantl- 
tative comparison between simulator and flight of the combined Induced 
behavior and pilot perception . This frees us from the notion that perfect 
fidelity is a one-to-one correspondence between simulator systems and the 

ie 

acttial aircraft a practical impossibility anyway. , Rather, perfect 

fidelity is characterized by the simulator pilot behaving in a manner 
appropriate to the aircraft situation. These Ideas do not, in essence, 
vary from the various concepts of simulator fidelity mentioned earlier. 

We suggest, then, that fidelity is the specific quality of the simu- 
lator which permits the pilot to execute successfully a given task as he 
would be accustomed in the actual aircraft. Execution of said task Is 
simply the organization of perception and closure of all loops^ made 
necessary by both the task requirements and the dynamics of the vehicle 
and subject to the Information which Is available. In order to close 
loops on the required states, cues corresponding to the states themselves 
must at least be defined, perceived, and recognized in terms of cardinal 
abstractions from the pilot's perceptual fields. This Implies first the 
requirement that: 

I 

• The task variables have been defined for the pilot. 

Task variables include the specific purposes, assign- 
ments, and commands comprising the mission strategy, the 


* This notion follows from the identical elements theory of transfer of 
Thorndike. 

t Including those involving cognitive choices, descisions, and discrete 
activities as well as those involving more or less continuous psychomotor 
activities. 
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likely gtiidance media, the vehicle to be used, and the 
likely disturbances, intrusions, and counteractions to 
be expected throughout the mission profile. Task 
variables comprise all the system inputs and those ve- 
hicular elements external to the pilot which enter 
directly and explicitly into the pilot’s assignment and 
affect the decision which he must make. 


Second, this implies the requirement that: 


• The feedback (and feedforward) cues essential to the 
task can be (a) adopted by the pilot and (b) discovered 
by the analyst. These are categorically called "essen- 
tial feedbacks" in Ref. 13. The feedback cues actually 
selected by the pilot will correspond to the states 
which are both necessary and sufficient to satisfy the 
decision-making, guidance, and control needs and certain 
pilot-centered requirements. 


The decision-making, guidance, and control needs are situation- 
specific. Satisfaction of these needs always involves the organization of 
perception and adoption of task-centered outer loops, with the addition of 
subsidiary inner loops and other axis crossfeeds as needed to promote the 
adoption of the outer loops in accord with the following pilot-centered 
requirements*. The feedback loops preferred are those which (Ref. 14): 

1. Can be closed with pure gain equalization by the pilot. 

2. Can tolerate a time delay which is characteristic of the 
appropriate modality. 

3. Require the least scanning activity to perceive the 
feedback cue. 

4. Permit great latitude in the pilot's adopted character- 
istics. 


* The Successive Organization of Perception (SOP) theory of skill 
development is treated in Refs. 1, 14, and 15. Sheridan (Ref. 16) has 
attributed the cognitive organizing activities represented by SOP to a 
functional construct called the "metacontroller" within the cerebrospinal 
portion of the nervous system. 
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Third, this implies the requirement that: 


• The cues corresponding to the essential feedbacks should 
be represented by coherent patterns in the perceptual 
fields which the pilot has learned (or will learn) to 
recognize in flight. Each intrinsic pattern, in turn, 
must be sufficiently coherent in situ to exceed the 
pilot's threshold of recognition* 


Fourth, this implies the requirement that: 


• The cardinal features which comprise the patterns should 
present a perceived signal-to-noise ratio to which the 
pilot is (or will be) accustomed in flight. 


Given the perceptual abilities of the pilot, there are four additional 
requirements regarding dynamic changes in cues corresponding to dynamic 
changes in the essential feedbacks. The change in cues or states must: 


• Be large enough to exceed the perceptual thresholds 
(e.g., vestibular thresholds or visual acuity) 

• Be qxiick enough to permit the closed loop bandwldths 
required (e.g., motion lags or visual update). 

• Be sufficiently distortion free to permit correct com- 
pensation by the pilot (e.g*, washout not too fast). 

• Be sufficiently noise free so as not to require workload 
for processing, filtering, or reconstructing patterns of 
change (e.g., motion vibration level, picture jitter, or 
flicker should be minimized). 


* Such coherent patterns have been called cardinal cues, abstractions, or 
features. Examples are discussed in Refs. 14 and 17-40. 
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Hence we have tied fidelity directly to perceived states and their 
characteristics in terms of: 

Threshold 

Quickness 

Distortion 

Signal-to-nolse ratio 

Each of these characteristics is, in turn, directly quantifiable in a 
variety of ways. For example, motion threshold is directly related to 
thresholds of the human vestibular system — although somewhat task depen- 
dent, nevertheless well researched quantities. Quickness is most likely 
tied to the control bandwidth required for a given task. Distortion may 
be as simple as specifying flatness of frequency response - — it implies 
that the amplitude and shape of response are adequate. Finally, signal— 
to-noise ratio relates to ease of detection and can be established on an 
empirical basis. 

It is important to recognize that the above concept of fidelity is 
based simply on the consideration of usuable cues for a specific task. It 
is founded on the notion that pilot behavior and perception can be charac- 
terized in terms which are compatible with the simulator on one hand and 
the actual aircraft on the other. A summary of this concept of simxilator 
fidelity is given in Table 8. 

B. LEVELS OF SIMDLATION 

Research into the human error and skill retention problem will require 
some degree of simulation. Simulation is also essential for evaluating 
the operator-centered characteristics of individual displays, communica- 
tion links, and controls in advance of operational test. Simulation 
offers, at present, the only way to measure crew workload under controlled 
(normal and abnormal) conditions. In turn, operator workload measures 
appear to offer a more sensitive discriminant than system error perfor- 
mance of incipient clrctmstances for human error. 
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TABLE 8 


A SUMMARY DEFINITION OF SIMULATOR FIDELITY 


SIMULATOR FIDELITY: 

The specific qiiality of presentation of perceivable states in 
terms of characteristics which are essential to Inducing correct 
psychomotor and cognitive behavior for a given task and 
environment. 


WHEREIN: 


Applicable states are chosen on the basis of specified task 
loop structure. 


Characteristics of states are determined by their role in 

inducing correct behavior i.e., quantification of loop 

structure adjustments (tightness, compensation). 


Several domains (e.g.. time, frequency; deterministic, 
stochastic) can be used to express characteristics of applicable 
states in terms of convenient fidelity parameters. 
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simulation provides a flexible and controlled environment for control-* 
display studies. Unlike operational tests, simulations can be limited to 
include only those features of the controls and displays and of the opera- 
ting environment that are directly related to the characteristics being 
investigated. This saves both time and money, since less equipment is 
required and more relevant data can be collected in a given period of 
time. Simulation also provides a means for controlling extraneous 
variables that are beyond practical control in operational tests. En- 
vironmental conditions, navigational aids, and operational procedures can 
be standardized and thus eliminated as factors contributing to the error 
variance in simulations. 

As always, these advantages are accompanied by several problems. 
Vehicle models and models of the environment are developed as abstractions 
from the highly complex real world. As such, there are invariably differ- 
ences between operator performance in simulators and in actual vehicles. 
Some of these differences can be reduced by intelligent selection of 
vehicle and environmental disturbance models, and the important aspects of 
the remaining differences can be minimized by careful selection of the 
questions to be answered by simulation testing. The simulation operating 
procedures can also have an effect on the human operator performance 
the airlines require the flight crew to be in full uniform during their 
simulations. Furthermore, the crew members know that failure to fly the 
simulator properly could cost them a high-paying job. These aspects 
greatly add to the realism of the simulation! In a research simulator the 
proper simulation of value (i.e., the worth or penalty) associated with 
the various system outcomes such as crashes, f\iel or time loss, etc., is 
very important but difficult to achieve. For example the consequence of a 
crash to flight crew members in real life is probably death which would 
engender a strong aversion to any action that might lead to this conse- 
quence. In a simulation then, some similar drastic consequence should be 
substituted, for example, elimination of the crew from the experiment. 
When carried to the extreme, the simulation and experimental scenario 
should have high fidelity in certain respects in order to encourage a 
utility structure that is similar to real world motivations. For example 
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this might Include flight decks, boarding areas, etc., that would attempt 
to evoke a mental set as close to real operational conditions as possible* 

While simulations are superior to operational tests for studying se- 
lected aspects of control-display systems, simulations become Inadequate 
as more and more complexities of the operating environment are required 
for the studies. The related Issues, simulation validity and subsystem 
fidelity^, have been discussed in the previous topic and in Refs. 9 and 42 
through 47. The simulation could conceivably consist of almost anything 
within the spectrum ranging from abstract laboratory tasks to a full scale 
mission simulation. The desirability of various degrees of simulation has 
been discussed at length In the literature (e.g.. Refs. 48 and 49) and the 
advantages and disadvantages of three levels of simulation are listed in 
Table 9. 

The ‘'missions** under consideration here Involve commercial, corporate, 
and general aviation transportation within the national airspace system 
under the applicable Federal Air Regulations (FARs). The concomitant 
skills required of both flight crew and air traffic control specialists 
are therefore reasonably well defined and, except for reacting to specific 
failures and emergencies, most skills are fairly well rehearsed. Thus, 
because the nature of the Intended research de 2 ils with detection and iden- 
tification of low probability events, we must provide a qualified endorse- 
ment of the "full mission simulation” in Table 9. The qualifications are 
listed among the "con" factors in the "full mission simulation" column in 
Table 9. 

For example. Ref, 3 anticipates that the MVSRF will conduct uninter- 
rupted flight simulations lasting several hours — — usually repeated on 


* Validity in this context is defined as the transferability of 
simulator performance results to the flight situation. Typical 
quantitative measures of transferability are summarized In Ref. 41. 

t Fidelity is defined as the adequacy of perceptual effects and their 
consequent pilot response (nature and timing) behavior Induced by the 
simulator for a specified task environment. (Refer to Table 8.) 


TR-1 156-3 


35 



TABLE 9 


COMPARISON OF THREE LEVELS 


OF SIMULATION 


Fall Mission Siaalstlon 

Part-Task Slaulatlon 

Synthetic Task Simulation 

Prox 

Pro: 

Pro: 

*Fscs Tslidity 

•Soae face validity 

•Can design tasks to measure basic 
behavioral factors 

*Moclvsclng to tsst subjocts 

•Less expensive than full alssion 

slaulatlon to establish reasonable 

•Relatively Inexpensive 

*Csn aid In syttes dsslgn 

fiducial statistics for node rat e-to-low 

•Convenient experimental design 

Con: 

probability events 

^CzpsnslTO 

•More convenient experlaental design 

•Can design low variability, 
highly sensltve tasks which allow 

^Fomldsbls Xeglsclcs In 

•Less difficult to neasure basic 

for efficient cxperlmencal design 

conducting sxpsrlosnt 

behavioral factors 

leadltig to reasonable fiducial 
statistics for specific tasks 

•Difficult to ossaurt basic 

•Manageable tralcdng requircaenta 

bshavloral factors 

•Offers a surrogate esvlronnent for 

•Can make allowances for more 
difficult envlroment 

•Difficult to ganarallza result a 

Ixiduclng crew fatigue, prior to aora 

to new situations; task-specific 

cooplete slaulatlon of tctalnal area 

•Workload measurements can be part 

•Difficult to oaks allowances for 

operations* 

of tasks 

actual anvlroo8»nt whan it does 

Con: 

•Can be configured to have face 

not coincide with test ettsirotaiienc 

•Difficult to generalize results to new 

validity for a general range of 

tasks 

•tforkload difficult to sieasure 

tasks 

without changing task 

•Difficult to oaks allowances for actual 

•Simplest training requirements 

•Very difficult and expensive to 

envlronaent when It does not coincide 

Con: 

establish reasonable fiducial 

with test envlrenneat 

•Hay have lower face validity for 

statistics for low-probablUty 

•Vorkload difficult to measure without 

specific mission simulation 

events 

changing task 

•Possible low motivational value 

•FomldabXe training rcqulreaents 

^tlll difficult anl expensive to 
establish reasonable fiducial statistics 
for very lew probability events 
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successive days with different flight crews and ATC specialists. To con- 
duct such simulation experiments will also require fixing schedules for 
experimenters and facility support personnel. Notwithstanding the Issues 
of facility reliability and maintainability which this type of operation 
raises, one should also re-evaluate whether or not a '*full mission slmu- 
lator** should be used for several hours to Induce crew fatigue and measure 
human errors throughout cruising flight In preparation for the more criti- 
cal terminal area operations. A simpler part-task mock-up of the flight 
deck might well suffice as a surrogate for accelerating fatigue, If It 
provided appropriately higher temperatures, relative humidity, sound, and 
vibration levels together with the necessary control-display equipment 
primarily for CNI and systems management tasks during cruise. Such a 
surrogate environment for Inducing crew fatigue could serve directly to 
make the more complete "specific mission simulator" more productive for 
terminal area research and less vulnerable to the Issue of reliability. 
Some of the qualifications for full and specific mission simulation have 
been expressed before by others, particularly In the context of training 
simulation, as exemplified by the following quotation: 


"I would not consider the money being spent on flight 
simulators as staggering If we knew much about their 
training value, which we do not. We build flight simulators 
as realistic as possible, which Is consistent with the Iden- 
tical elements theory of transfer of Thorndike, but the 
approach Is also a cover-up for our Ignorance about transfer 
because In our doubts we have made costly devices as realis- 
tic as we can In the hopes of gaining as much transfer as we 
can. In these affluent times, the users have been willing 
to pay the price, but the result has been an avoidance of 
the more challenging questions of how the transfer might be 
accomplished In other ways, or whether all that complexity 
Is really necessary." (Ref. 50) 


In contradistinction, the "synthetic task simulation" In Table 9 
enables the Investigator to design low variability highly sensitive tasks 
which provide not only basic behavioral factors but may also provide work- 
load measurements. Thus the experimental design tends to be more 
efficient and usually leads to reasonable fiducial statistics for specific 
tasks. There Is a cost for this, however, among the "con" factors In the 


TR-1 156-3 


37 



^synthetic task simulation** column in Table 9* The synthetic task simula- 
tion may have lower face validity for specific mission simulation and a 
possibly low motivational value among the population of subjects for the 
tests. As a consequence, **part-task simulation** (middle column in 
Table 9) is the most prevalent compromise for the purposes of research and 
development, although the **specific mission simulation** continues to 
prevail for the purpose of flight and ground control training in spite of 
the dearth of objective data justifying its necessity. 

Very complex mathematical models do not necessarily guarantee high 
simulation fidelity or validity. Complexity can just as well impede the 
effective use of simulators and can foster a false sense of well being. 
Let us explain. 

Simulator models are freqxiently developed using actual wind tunnel 
data, detailed flight control system diagrams, replication of aircraft 
cockpit layouts, and anything else which may be regarded as the last word 
in definition of the actual aircraft, as noted previously. While there 
may be an undeniable correctness in such descriptive information, it may 
lead to such complex model definition that thorough checkout is impossible 
within a reasonable period. Furthermore there might be no perceptible 
difference in the Induced pilot behavior over a less complex model. 

The other side of the complexity coin is that simple models are sus- 
pect — their credibility is open to question. And demonstration of their 
value or fidelity may be just too costly. It is important to search out 
the middle ground, however. 

The level of complexity of simulation must be set such that two things 
are possible: 

1. The model must permit effective verification and check- 
out — this favors simplicity. 

2. The model must enjoy credibility — this often (but not 
always) favors complexity if the background information 
for justification is itself complicated to express. 
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C. CRITERIA FOR FIDELITY OF THE SIMDLATED IFR COCKPIT, 
EXTERNAL VISUAL FIELD, AND MOTION AND AURAL CUES 


Our approach to this problem is unique and may be described as 
follows. If the compromised visual, aural, and motion cues are such as to 
elicit the correct (real world) pilot behavior (but not necessarily iden- 
tical system error performance) in the simulator, then a positive benefit 
is obtained from the simulation and negative transfer will be minimized. 
By pilot "behavior” we mean the nature and timing of his control actions, 
and the use of corresponding input cues. 

Although a pilot's actions are varied, we must focus our attention 
among those actions which exert control on the aircraft, if we are to 
address the critical issues affecting the role of simulation in the 
MVSRF. By so limiting the conceptual context, we also help to convert an 
unmanageably complicated general problem to a manageable complicated set 
of specific problems. 

The conceptual context for defining and measuring pilot behavior 
derives from the following observations: 


• The pilot involves himself in guidance and control loops 
which relate perceived elements of the visual field to 
his vehicle control actions in a coherent (and even 
predictable) way. 

• The pilot optimizes the dynamic properties of the con- 
trol loops by suitable behavioral adaptation, 

• There is a cost to the pilot for this adaptation: in 

workload-induced strain, in concentration of his facul- 
ties, and in a reduced potential for coping with the 
unexpected. 

• Motion cues may provide an alerting and triggering 
stimulus which activates an internal command generator 
within the pilot. This is perhaps most important for 
unusual recovery maneuvers. 

• Motion cues indicative of status, such as moderate vi- 
bration, buffeting, stick— shaking, or moderate steady 
acceleration also provide an alerting stimulus and a 
consequent increase in neuromuscular tension. This 
reduces the effective neuromuscular time delay, thereby 
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permitting the pilot to operate with a higher gain, 
which may improve flying precision. Higher steady and 
vibratory accelerations, however, will ultimately de- 
grade the pilot's gain and be counterproductive. 

• Motion cues which conflict with the visual modality can 
cause illusions which distort the pilot's perception of 
the situation. If sxich conflicting motion cues are not 
disregarded, they can severely degrade the pilot's con- 
trol capability. 

• Vehicle motions sensed by the pilot which do not con- 
flict with the visual modality are used as the basis for 
closed-loop control. 


These observations are developed more completely as fimdamental concepts 
for characterizing human pilot behavior in Ref. 14. In lAat follows we 
shall consider each of several classes of simulated cues in turn. 


1. Head-Down Cockpit Displays, 

Controls, and Procedures 

The representations of head-down cockpit displays and control "feel" 
characteristics in flight simulators have achieved such a high degree of 
identity with their prototypes that, with a modest capital investment, 
fidelity can be assured currently as long as careful attention is given to 
the mathematical modeling of the Interacting vehicle and environmental 
dynamics. Partial task research simulators, however, usually lack realism 
in the normal cockpit procedures which are essential features of flight 
training simulators. Sometimes omitted are checklists, air-to-gro\ind 
communications, copilot altitude and airspeed callouts, and activities 
such as selecting and interpreting radio navigational aids and making 
configuration changes. Although deliberate omission of such discrete 
tasks is perhaps expedient in partial task simulation, it does help to 
destroy the illusion of flight and, more crucially, may eliminate workload 
which is Important to an evaluation of the impact of unexpected events in 
the MVSRF. 



2. Visual Cues (Including Head-Dp Displays) 


The representation of the various and sometimes complex elements of 
the external visual scene (Including collimated head-up displays) must be 
adequate to evoke (and allow) pilot control behavior typical of that in 
the real world* This does not necessarily mean a high fidelity represen- 
tation in the photographic sense. It is pos Sibley however, to base the 
adequacy of image quality and movement performance in the representation 
of the external visual scene on known limitations of the human visual 
system for the specific flying task in question (Ref. 11). It is also 
possible to base the adequacy of the image presentation technique (l.e., 
real or virtual) on a psychological measure of realism (Ref. 44) \rtiich is 
related to the pilot's perception of the external world in flight 
(Ref. 47). 

It is also possible to base the adequacy of content and field of view 
in the representation of the external visual scene on the (predictable) 
characteristics of the pilot-vehicle system for the specific flying task 
in question (Refs. 18 and 51). For example, the simulator visual scene 
must provide adequate cues for attitude (pitch and roll) and heading ref- 
erences. Close to the ground, lateral and vertical position references 
are needed for landing, be they provided by representations of the ground 
plane, buildings, patterns of lights, visual landing aids, or whatever. 
Further, the capability of degrading the visibility of these references 
(e.g*, by obscuration or reduced contrast) would also appear necessary for 
adequate representation of transitions from instrument meteorological 
conditions (IMC) to visual meteorological conditions (VMC) during the 
landing approach. The result of these considerations is that the fidelity 
objectives for the visual scene become task— dependent • when related to 
pilot control behavior for a particular class of vehicles. 

3. Motion Cties 

The subject of motion cue simulation is about as complex as the one of 
visual cues. The basic problem is that, except in special circumstances. 
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it Is impossible to simulate the physiologically perceived motions on a -n 

one-to-one basis. The angular motions could be provided relatively inex- 
pensively, but large translational displacements would also be required, 
and these are extremely expensive. The most difficult sitiiations for 
getting realistic motion cues are maneuvers which involve sustained normal 
accelerations, such as turns, pull-ups, and flares. Sustained lateral and 
longitudinal specific forces, at least of low magnitude, can be simulated 
by what is commonly referred to as residual tilt. This involves tilting 
the simulator cab relative to the vertical and using gravity to provide 
the sustained specific force components without having to accelerate the 
cab. For example, the acceleration during a takeoff can be simulated 
quite well by simply tilting the simulator cab backward and the decel- 
eration during an approach, by tilting the cab forward (Ref. 45). 

Given that motion cues cannot really be duplicated on a one-to-one 
basis, the usxial procedure is to provide compromised motions within the 
physical constraints of a particular simulator. This usually Involves a 
combination of three techniques: scaling the motion down, washing it out, 

and using residual tilt. Scaling the motions by some factor directly ) 

reduces the travel reqtiirements. Washout circuits allow duplication of 
high-frequency components of the motions without a large amount of 
travel. The rationale behind the use of washouts is that the pilots use 
motion cues primarily as high-frequency adjuncts to the visual cues. The 
pilot may sense the roll motion from a gust before he sees the effects on 
his instruments or in the visual scene. Conversely, pilots are taught to 
ignore low-frequency motion sensations because they are unreliable. 

The obvious question is; why simulate the motion at all, if compro- 
mises are necessary? . Why not just have a fixed-base simulator? For one 
thing, the motion certainly contributes a psychological sense of realism 
for the pilot subjects. Even more important, motion cues can be very 
helpful to the pilot in certain situations. Motion cues can help in the 
pilot’s responses to an engine failure or a hardover control system 
failure. They can also help the pilot’s ability to control a difficult 
set of dynamics when the external visual field is also available 
(Ref. 52). It is generally recognized that motion cues are usually more 
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important when trying to evaluate the controllability of more difficult 
aircraft dynamics, such as those associated with a backup flight control 
system. 

The pilot's perceived motion cues are a source of information which 
can be used as a control feedback. The pilot feedback selection hypothe- 
sis (Ref. 14) states that the pilot will use whatever feedback signals are 
available and helpful to him in accomplishing his task. Such feedbacks 
may be among visual, motion, or aural types. In the simulator, pilots may 
be deprived of helpful cues which exist in the real world, but they may 
also learn to use helpful but vinrealistic cues which are artifacts in the 
simulator (Ref. 53). Thus one must be cautious about providing only angu- 
lar motion cues in the simulator (which are potentially useful to the 
pilot), but which are not present in the real world without corresponding 
specific forces which accompany translation. 

Recently Systems Technology, Inc. , (STI) has been investigating (in a 
cooperative program with the 6750th Aerospace Medical Research 
Laboratories at Wright-Patterson Air Force Base) the role of motion cues 
in piloting tasks. A careful set of experiments on the WPAFB Dynamic 
Environment Simulator (DES) and Large Amplitude Multi-Mode Research 
Simulator (LAMARS) are under way. Data from these experiments are showing 
that, as predicted by the validated pilot-vehicle theory (Refs. 52, 53, 
and 54) motion cues are useful for disturbance regulation but are less 
useful for visual target tracking (Ref. 55). 

4. Aural Cues 

Aural cues in flight come from several sources including: noise gen- 
erated by air flowing over the aircraft, rotor, propeller or fan noise, 
engine noise, landing gear and flap actuation sounds, and runway rumble. 
Except for rotor and engine sounds, aural cues seldom provide Important 
feedbacks to the pilot. 

The pilot can confirm power changes based on the sounds without having 
to monitor continuously his rotor and engine instruments. In situations 
where frequent modulation of power is part of the task, simulation of the 
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rotor and engine sounds can be quite important* It is therefore essential 
to have the proper dynamics or lags between the pilot's movement of the 
power or thrust controls and the accompanying engine sounds. 

In many simulators the rotor-and-engine noise is simulated, not so 
much as a useful cue to the pilot, but to mask the noises made by the 
motion system* The noises made by the motion system may be useful but 
unrealistic feedbacks and, at best, are a source of distraction and annoy- 
ance to the pilot* 

5« Element of Surprise 

One of the most difficult types of experiments to do in a simulator, 
or in flight, is to study engine, aircraft, or flight control systems 
failures or wind shear encounters. The basic problem is the lack of the 
element of surprise* When the pilot expects a wind shear or knows he is 
going to get a failure on a particular run, his response certainly is not 
going to be typical of what happens in the real world when the failure is 
unexpected* If an entire experiment is devoted to studying wind shear or 
failure conditions, it is difficult to get this element of surprise other 
than, perhaps, the first time* If, on the other hand, the experiment 
includes other objectives, some element of surprise is possible* The idea 
is to mix the wind shear or failure experiments with other more routine 
parts of the test, so the subjects never know exactly when they might get 
a wind shear or failure* The results are still not completely realistic, 
but at least it is a step in the right direction* 

6* Summary 

This approach to assessing the value of a slmulted situation has 
served well in a number of investigations, ranging from the study of (a) 
various forms of beam stabilization logic for the Fresnel Lens Optical 
System (FLOLS) (Ref* 56) through (b) the Investigation of a large number 
of aircraft handling qualities problems on fixed-based simulators to (c) 
the refinement and effective operation of a number of FAA and NASA STOL 
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aircraft moving-base simulations at the NASA Ames Research Center's Flight 
Simulator for Advanced Aircraft (FSAA) (Refs. 57 through 60). 

To summarize^ we base our approach to determining the adequacy (i.e.^ 
fidelity) of the simulated visual field and motion cues on a well vali- 
dated combination of pilot-vehicle theory and experiment which shows that 
the elicitation of correct decision-making and control behavior, measured 
by sophisticated control-theoretic techniques (such as pilot describing 
functions and structured parameter identification), is the best criterion 
for fidelity. It is this important concept, which is substantiated in 
Ref. 2, which we recommend to identify the critical issues affecting the 
incidence of human error in the MVSRF. 
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SECTION III 


VISUAL FIELD 


For limited or fully Interactive piloted control in landing, the 
visual field display is essential as the primary means for monitoring and 
effecting attitude and path control of the aircraft. Here realistic 
visual scene cues are required so that familiar piloting reflexes can be 
employed. 

Functional requirements for the visual field display fall in the cate- 
gories of field of view, resolution, color, interactive image generation, 
image presentation optics, and update rate. 

A. FIELD OF VIEW 

At first thought, one would think that the largest display (in terms 
of lateral visual arc) would be desirable, since many of our motion cues 
appear to come from "streamer” notion in the peripheral areas (30 deg to 
70 deg off axis). Ref. 24 - 26. Certainly such wide fields are more 
realistic and are needed for airborne traffic detection, ground roll-out, 
taxi and docking. On the other hand, we have noticed that the larger the 
visual field (in terms of percent of retina covered), the greater is the 
sensitivity to missing physical motion cues. It has been well established 
by Graybell and his colleagues (e.g.. Ref. 61) that "vertigo," "disorien- 
tation," and motion sickness stem primarily from conflict between the 
perceived visual and physical motion cues. If strong motion cues are 
supplied visually (especially parafoveally) but not physically, a vertigo 
effect results. This can increase with time of exposure from vague 
stomach "awareness" to acute malaise, or frank sickness. Nearly everyone 
is familiar with this effect while watching a 160 deg Cinerama picture 
taken from a rollercoaster, airplane, or fire truck (thousands of viewers 
at Disneyland's 360 deg Circle-Vision show have queasily experienced the 
latter). Yet the same scene compressed to a small area (as on a TV-replay 
of the same Cinerama movie) does not induce vertigo, because the visual 
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surround is not moving. Thus there is a paradox to be resolved; a wide 
view enhances realism of the situation but causes distraction in the form 
of vertigo. 

A crude estimation of the compromise visual field size can be made 
from a rough plot of anecdotal experience, as shown in Fig. 5. Further 
research should be done to quantify more precisely the apparent correla- 
tion shown. For present purposes, if the probability of vertigo is to be 
"occasionally," we conclude that a display having aspect ratio: 

wldthiheight •• 2:1 should subtend not more than 20 to 25 percent of the 
visual field to avoid short tetn vertigo. This implies a visual display 
subtending at the viewer about (40 deg to 80 deg) wide by (20 deg to 
40 deg) high. 

A wide field of view is Important for the MVSRF because a number of 
the visual cues come from angles of 15 or 20 deg from the line of sight 
(e.g., the so-called "streamer" effects are predominant in the regions 
from 20 to 40 deg from the Instantaneous vehicle velocity vector, see 
Refs. 23, 25, and 26). In our* opinion, after performing simulated 
landings on both the Ames Research Center S05 Flight Simulator (which has 
s ± 15 deg field of view) and the SAAB Draken simulator (which has a 
± 30 deg field of view), that the SAAB system is much more "realistic" and 
easy to use in a visual flight rules (VFR) manner than the Ames Research 
Center system, primarily because of a wider field of view. Unfortimately, 
an adequate research basis on which to select the desirable field of view 
for the visual representation is not yet available. 

B. RESOLUTION 

A "high acuity" projected image is the next most Important visiial 
field representation requirement. This is a complex combination of good 
imaging resolution capability (measured by visual angle limits) and high 
brightness contrast ratio. The ideal resolution would be equivalent to 
about 1 arc-mimte at the eye, and 3 arc-minutes is generally considered 
good (e.g.. Ref. 37). For a cathode ray tube (CRT) raster display over a 
± 25 deg field of view this requires a 1000 to 2000 line display. These 
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PROBABILITY OF VERTIGO (SHORT TERM ‘AWARENESS’) 



Figure 5. Anecdotal Experience with Vertigo versus Screen/Size 
When Viewing Dynamic Scenes from a Fixed-Base Situation (Ref. 62) 
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reqxilrements are at the edge of the current state-of-the-art in CRTs* The 
CRT is further limited hy a brightness contrast ratio on the order of 
100:1 (as compared with cinematographic contrasts of around 1000:1). 
However large, monochrome, monitor-quality television displays of 1000+ 
line capability are now becoming available and are certainly worth 
considering. 

C. COLOR 

The need for color in the simulated visual scene is much more contro- 
versial than that for high resolution, probably because of the present 

difficulty in providing both. At a less-than-desired resolution level, 
some preliminary data on the desirability of color (and of a collimated 
CRT monitor versus a large nearby screen) is available from experiments 
reported in Refs. 63 through 66. Figure 6 shows the consensus of several 
transport pilots after performing hundreds of landings in the 805 Flight 
Simulator at Ames Research Center, using each of four display presenta- 
tions: monochrome on screen, color on screen, monochrome collimated CRT 

monitor in window, and color collimated CRT monitor, all with a 625 line 

raster with roughly comparable fields of view (± 15 deg). The color moni- 
tor was considered best, monochrome monitor next, the projector in color 
next, and the monochrome projector the least. In certain situations 
(e.g. , clear day VFR flight and low speed flight) the color was considered 
to add considerably to the optical contrast and to permit easier identifi- 
cation of significant land features. Under low visibility conditions, 
where color contrast is reduced anyway, the monochrome systems were not 
considered much worse than the color systems. 

In the landing approach, the pilot's range and height perception, 
tracking precision on glide path, and decision to land or to go-around may 
well be influenced by the representation of color. Reference 67 points 
out that color provides an essential dimension for contrast cues, e.g., 
the blue scattering of the clear atmosphere with increasing range, the 
yellow scattering of the aerosol with range and height in urban areas, the 
absorption of color by water vapor with Increasing range, and the gradual 
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loss of color perception as the light level reduces the effectiveness of 
photoplc vision# 

Under simulated night landing conditions the effects of chromostereop- 
sis have been examined by comparing red approach and blue taxiway lights 
with blue approach and red taxiway lights in Ref# 66# Significant differ- 
ences in altitude error and time away from glide path were found# With 
equidistant lights, red lights always appear to be nearer than blue# Red 
lights conventionally placed under the approach path as warning indicators 
of the runway threshold produce an illusion to the pilot that the aircraft 
is closer to the threshold than it actually is# 

An additional factor, which may be significant in the precision 
landing control task at night, is the human response time delay to chang- 
ing patterns in color. For foveal vision blue provides about 18 percent 
shorter response time delay than red (Ref# 67)# With a nominal delay of 
300 msec, such a difference is comparable with a typical digital compu- 
tation delay in a visual simulator# 

D# INTERACTIFE IMAGE GENERATION (FROM REF. 68) 

Interactive image generation is essential for piloted landing simula- 
tion under VFR# **Interactive“ means that the image of the visual scene is 
correctly influenced by the aircraft's translational and rotational 
motions induced by control inputs and disturbances# 

At the present time CRT stroke writing (calligraphy) is probably the 
simplest medium for providing an interactive visual display of both the 
real world and electronically superimposed head-up display symbology# 
Cathode ray line graphics can be generated rapidly with electronic 
circuits (including hybrid computers), and intensity control can be used 
to obtain the desired range of image brightness# Graphic complexity and 
brightness are acceptable for generating night visual scenes# A large 
number of electronic computations can be arranged to operate in parallel 
so that image update rates can be maintained compatible with frame rates 
required to produce displays with excellent dynamic characteristics# This 
is not necessarily the case with digital computer-generated Imagery, 
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however, which Is limited by the serial processlog characteristic of digi- 
tal machines and where dynamic capability tends to be inversely propor- 
tional to image complexity. Table 10 presents some advantages, 
disadvantages, and typical examples of the use of each of these electronic 
approaches for generating interactive visual fields. We shall now discuss 
each technique in more detail. 

1. Night Visual Graphics 

f 

A night-only visual system is recommended in the first phase of de- 
velopment for MVSRF. A relatively low-cost approach to night visual field 
representation can be provided by several computer graphics systems cur- 
rently available as summarized in the first three columns of Table 11 
which has been prepared with the aid of Refs. 69 through 73. (The fourth 
and fifth columns of Table 11 will also be used subsequently to represent 
examples of a display graphics generator for reproducing primary head-down 
displays in the flight deck.) These monochrome systems allow the control 
of a large number of points and vectors at update rates sufficient to 
present a subjectively smooth, continuous scene to the pilot together with 
electronically superimposed head-up display symbology. Visual perception 
of landing scene cues seems to be adequate with these systems (Refs. 74 
and 75). The advantages of this approach are reasonable cost, program- 
mability, and a common digital Interface between the graphics system* s 
dedicated computer and the "host" computer. The disadvantage of this 
approach is the absence of color. More expensive chromatic computer- 
generated approaches are possible, as discussed later, but the Evans and 
Sutherland Picture System Z in Table 11 and the Evans and Sutherland 
Multi-Picture System, described in Table 12, offer growth capability for a 
high resolution red-green-blue (RGB) shadow mask color display at higher 
cost than monochrome Picture System 2 but at lower cost than computer- 
generated image (CGI) systems. 

Meanwhile, Refs. 65 and 66 describe activities by Wendell Chase, a 
scientist at Ames Research Center, in pursuit of a relatively lower-cost 
(circa $100K) full-color computer-generated visual field simulator 
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ELECTRONIC APPROACHES FOR GENERATING INTERACTIVE VISUAL FIELDS 


TCPE 

TTPICAI. EXAMPU3 OP USE 

ADVANTAGES 

OISADVAHTAGBS 

FLYINQ TASKS 

NON-FLYING TASKS 

Electronic 
cally 
Generated 
Calligraphic 
Imagery 
(Parallel 
processing by 
special pur- 
pose or 
hybrid 
computer) 

Virtual Image Takeoff and Landing 
(VITAL); Light Airborne Multl- 
Puriwse System (LAMPS) 

AF Avionics System Analysis and 
Integration Lab; Digital Avionics 
Information System (DAIS) 

Naval Air Development Center — 
Advanced Integrated Display System 
(AIDS); Aerospace Medical Research 
Laboratories 

AP Human Resources lab — Advanced 
Simulator for Undergraduate Pilot 
Training (ASUPT) 

AF Aerospace Medical Research lab 
Langley Research Center 
Pacific Missile Test Center 
Airframe Development Industry 
Naval Training Equipment Center 
AP Aeronautical Systems Division 

Systems Technology, 
Inc. 

MIT Man-Machine lab. 

Calspan 

U.C. Berkeley 

SAAB 

Volkswagen 

High repetition rates for dynamic 
displays 

Continuous Intensity control 

No time penalties for computa- 
tational complexity (parallel 
processing) 

Natural for dynamic, interactive 
display (high rates of motion) 

Sharp resolution of far field 

Complex scenes impractical 

Basic contrast and brightness 
limitations of CRT’s 

Difficult to render colored 
objects 

Not easily altered by 
reprogramming 

Digital 

Computer 

Generated 

Imagery 

(Calligraphic 

or Raster) 

U* 111., Inst, of Aviation Research 
AF Flight Dynamics Lab 
Ames Research Center 
Johnson Space Flight Center 
Naval Air Development Center 
AF Human Resources Lab 
AF Aeronautical Systems Division 
Singer 

General Electric 
U. North Carolina 

Easily programmed (potential) 
Complex scenes with solid objects 

Time penalties for increasing 
scene complexity (seriea can- 
putation processing) 

Intensity gradations difficult 
Quantization of far fields 
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COMPARISON OF GRAPHIC SYSTEMS 


Homenclature: 

Picture System 2 

Graphics 7 

Series 5400 Interactive 
Graphics Display 

Graphic Display System 
CCT-5000 

Series 9000 
Graphic Display System 

Vendor: 

Evans and Sutherland 

Sanders Associates, Inc. 

Vector General 

Genlsco Cemputers 

Ramtek Corporation 

Home Office: 

Salt lake City, Utah 

Nashua, Hew Kanpslilre 

Woodland UiUs, California 

Irvine, California 

0aaU Clara, CaUforaU 

Price Ranee: 

$70K up Monochrome 
i^OK extra for color* 

$55K up Monochrome 
it to 5K extra for CSS-4 
FORTRAN Grapliics Support 
Software 

$ 4^ up Monochrome 

FORTRAN Grac^ilcs Support Software 

|40K up Monochrome 

or color with cursor control 
option via Joystick 

1 60K up Modular Monochrome 
or color with cursor control option 
via Joystick and process control 
keyboard option 

Type of Display: 

Calligraphic only 
Mi croprogransnable 
Character and Line 
Generators 

Independent intensity and 
contrast control 

Calligraphic only 
Mi croprogrammable 
Character and Line 
Generators 

Brightness, contrast, 
focus controls 

Calligraphic only 
Mlc reprogrammable 
Cliaracter and Line Generators 

Intensity Control 

Raster scan only 
MicroPro grsnanable 
Conrac high resolution colored 
dot matrix tube 

Raster scan only 
Ml croprogrammab le 

Mitsubishi colored dot matrix CRT has 
2X resolution of Conrac sod ia 
available in 15- in diagonal 

Kaxinium Number of 
Dis play s/Cont roller: 

6 

4 

4 

Unlimited 

4 to 12 

X * Y • Z Addressable 
Locations/Display: 

U096 • 1*096 • 64 

2048 . 2048 . 8 

4096 • 4096 • 4096 

1024 * 1024 . 1*096 

From 320 . 240 . 256 
To 640 . 512 • 4096 

Line Stroke Set 

6 with adJusUble blinking 

4 with adjustable blinking 

6 textiures with adjustable 



Alphanumeric Character 
Type: 

Set: 

Size: 

Cursive stroke 
95 ASCII 
6 std 

Cursive stroke 

96 std, 96 optional ASCII 

4 

blinking 

Cursive stroke 

96 ASCII std, 192 optional 

4 

(Bit nap type refresh 
expeindable from 1 to I6 
bits /picture element) 

(Bit map type refresh expandable from 
1 to 12 bits/picture element) 

64 ASCII std, 129 opUonal 

Refresh Controller: 

Automatic 

Microprogramnable 
(40 instructions) 

Programnable (6 instructions) 

Automatic video control 

Automatic video control 

Refresh Rate: 

Selectable among first 
16 Integral multiples 
of l/t20th sec 

60, 40, or 30 Hzj or 
free-running 

60 or 50 Kz 

60 or 50 frames/see 

60 or 50 Hz 

Display Processor 

Mi croprogrammable 

Mi croprograaraab le 
(400+ instructions) 

Microprogramnable (47 instructions) 

Mlcroprogranmable (5I Instruc- 
tions) tdth 150 nsec cycle 
time 

Microprograionable (26 instructions) 
with 350 nsec cycle time 

Hodulax Memory 

i 

16 k 16-blt words expand- 
able in 16K Increments 
to 64 k words 

ROM 4K 16-blt words 
RAM 8K to 24 k words 

52K 16-blt word refresh buffer 
4K 24-bit word control program 
247-word ROM constant file 
24d-word RAM data file 

1 

256 16-blt words RAM 
1024 16-blt words RAM 
1024 16-blt words RAM 

4K 12-bit word refresh RAM 
2K bytes program ROM expandable to 
16K bytes 

512 bytes scratchpad RAM expandable 
to 8,7K bytes (2 bytes»one l6-blt 
word) 

Host Computer Interface ; 
and Software: 

Rc 1 iab 1 11 ty/Maintain- 
abiUty 

Parallel 16-bit word 

Synchronous at 6-2/5 M 
words/sec 

Designed for DEC PDP-11, 
but can be used with 
others at extra cost* 
Uses FORTRAN calls. 

Periodic diagnostic main- 
tenance contract @ 

0,1% of ptirchase price 
per month plus $50/ 
display or ^^650, which- 
ever Is greater. 

Damaad maintenance serviee 
2 $59/hr plus parts and 
travel expenses. Mini- 
mum hr/vislt. 

Serial RS-232C, 960O baud 
std. or parallel l6-blt 
word 

Synchronous at 0.5 M 
words/sec 

Designed for DEC PDP-11, 
but can be used with 
others. GSS-4 resides 
in 2K word memory of host. 

i 

Designed for DEC PDP- 11/45 with 
RSX-11D operating system, which 
uses 52K word memory. Need at 
least another 52K word memory. 

i 

Designed for fX)VA cemputer, but 
PDP-11 acceptable. No high- 
level software available. 

Would need software support. 
RAND Corp. uses Bell 
operating system. 

Periodic diagnostic maintenance 
contract & 1^ of purchase 
price per month* 

ParaUel 1 6-bit word 

Synchronous at I.5 M words/sec 

6 different computer interfaces have 
been developed, incl. DEC PDP-11 
series, Varlan 620 and 75 series. 
Some high-level software available, 
but would need software support. 

High teniperat\u*e bxirn-in of each 
system Is used to isolate ond replac 
premature component failures. No 
special preventive maintenance 
required. Demand maintenance 
contract (3 4jt of purchase price 
per year provides 48 hour response. 
Technician at East Coast office 
as wC April V9T?. 


* Red-green 'blue (R'lQ) shnduv^ masX monitor provides lower intensity than monochrome. 



TABLE 12 


EVANS AND SUTHERLAND MULTI-PICTURE SYSTEM (MPS) 
(Adapted from Ref. 76) 


The MPS offers several advantages and some disadvantages. The advan- 
tages are summarized below in two categories. The first assumes the use 

of a minimum system one monochrome station. The second category of 

advantages covers potential growth capability available through MPS op- 
tions. The disadvantages are presented last. 

Advantage s> Initial 

1. Ability to generate runway symbols and lettering . The MPS 
can draw any symbol on the runway and display It with the 
proper perspective. 

2. Greater flexibility. With the MPS it is possible to trade 
off scene complexity and update rate. One experiment might 
use a very fast update rate with a simple display. Another 
may not require the fast update and could use a much more 
complex visual scene. These can also be tradeoffs between 
complexity In the runway delineation and In the other dis- 
play elements (such as other aircraft). 

3. Alphanumeric capability . The MPS can draw alphanumeric 
characters as well as straight lines. This capability could 
be used to generate traffic situation displays. 

4. Maintenance. The MPS is a standard off-the-shelf component 
and a maintenance contract is available from the manufac- 
turer. 

Advantages, Growth Capabilities 

Color . The MPS has built-in color control capability and 
requires only the addition of a color display (price 
$50,000). The color display is a high resolution, shadow- 
mask monitor. ' The drawing speed Is the same as the 
monochrome monitor and Is several times faster than beam- 
penetration monitors. 

2. Increased field of view. One MPS can generate multiple 
views of the same data base (with a corresponding reduction 
in the maximum number of lines or update rate). With 
another kinescope this capability could be used to double 
the forward field of view or to add side or rear displays. 
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TABLE 12 (Concluded) 


3. Controller’s eye view . The multiple view capability noted 
above could be used to generate a special display for the 
controller or experimenter so he could more readily monitor 
the progress of the simulation. A controller's eye view of 
the simulated terrain with a moving symbol for the subject's 
aircraft would be possible. 

4. Interactive graphics for scenario generation . A common 

application of the MPS is for interactive graphical design 
systems. A variety of I/O devices for these types of appli- 
cations are availlable from Evans and Sutherland: data 

tablet, light pen, keyboard, joystick, dials, switches, and 
lights. With some of these devices and the support software 
which is Included, an Interactive graphical experimenter's 
station could be developed. This station would provide a 
sophisticated man/computer Interface for the generation and 
modification of test scenarios. 

Disadvantages 

1. Higher cost . The MPS would definitely cost more than 
Picture System II. 

2. Only draws straight lines or data . The MPS will use a num- 
ber of lines to draw a dashed line or approximate a curve. 

3. Does not draw wide line . The MPS only draws thin, straight 
lines. Multiple parallel lines could be used to approximate 
a wide line (or to fill In a solid symbol). The number of 
lines and spacing required would probably have to be deter- 
mined experimentally. 

4. Fixed intensity variation with range . The MPS can vary line 
intensity with range from the viewer; furthermore, the 
ranges for maximum and minimum Intensity can be controlled 
by the host computer. What the computer cannot do Is change 
the shape of the intensity variation with range, for 
example, to match that In fog. The shape of the Intensity 
variation with range can, however, be altered by hardware 
changes at extra cost. 
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designed specifically for landing, Which may have possible future appli- 
cation to MVSKF. 

This new device, which Includes a synchronized field-seqtiential 
colored filter wheel, has provided a full-chromatic spectrum for Improving 
the perceived realism of night visual calligraphic generators. This new 
chromatic projector permits drawing 2000 vectors In as many as 500 colors, 
all above critical fusion frequencies and using high scene resolution and 
brightness at levels acceptable to the pilot within the maximum capabili- 
ties of 1000 (scan) lines and 100 fL. System and pilot performance 
measures and pilot opinion (Fig. 6) obtained in experimental Investiga- 
tions support the hypothesis that using a chromatic visual field simulator 
for landing Improves both pilot and system performance. 

The components of Chase's computer-generated display system are: (a) 

a Systems Engineering Laboratories SEL 840 digital computer, (b) an Evans 
and Sutherland Line Drawing System LDS-2, (c) a field sequential color 
projector and Its rear projection screen, and (d) the supporting optical 
collimating lens arrangement for viewing the Image of the visual field. 
The display can be presented on a five-inch diameter 40,000 volt mono- 
chrome CRT. Interposed between the f/1.0 projection leixs and the CRT is a 
24-inch diameter color wheel comprised of four sectors (red, green, blue, 
and clear). The rear projection screen Is placed at the focal plane of 
the projection lens. Three photo diodes located on the rotating color 
wheel are used to synchronize the stroke— writing periods for the field 
sequential process. Two 25— Inch diameter collimating lenses provide the 
pilot with a virtual Image from the real Image presented on the rear pro- 
jection screen. The virtual Image can be positioned ahead of the pilot 
from 10 ft to infinity. Interposing the rear projection screen causes 

some loss In resolution. One of the advantages of the rear projection 

scheme, however, is that It can be viewed off-axis with an acceptable 
level of distortion, thus allowing the pilot a range of lateral and ver- 
tical head movement within a diameter equal to the size of the real Image 
on the rear projection screen. 
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2. Coaputer-Generated Image (CGI) Display System 

The computer-generated image scheme is at the frontier of the state of 
the art. Table 13 provides a concise comparison of some of the salient 
features of six systems for generating visual field images in color. 
These systems are designed specifically for pilot training. To generate 
even relatively simple Images with appropriate perspective and update 
rates compatible with real-time operation (at least in the 30 to 40 Hz 
update frequency range) requires a relatively powerful dedicated digital 
computer. The image can be created via either calligraphy or modulated TV 
raster. In either case, the pilot flys in a cartoon world of extreme 
visual simplicity, which may be limited to night-time scenarios, because 
of the higher cost of daytime CGI. It offers the greatest future poten- 
tial for research because of its inherent flexibility, but the hardware 
and software requirements and costs are substantial. 

Since the advent of the original General Electric (GE) CGI in the 
early sixties, significant studies have been made by several companies in 
achieving increased capability and scene complexity. The Evans and 
Sutherland Day/Night CGI, GE CGI, and Marconi TEPIGEN are the only true 
full color systems which are presented in a standard video raster. The 
other three systems, which are calligraphic and more modestly priced, are 
presented on beam penetration color CRTs which lack a blue phosphor. 
Personal observation has shown the colors to be subjectively quite appeal- 
ing, however. 

As noted in Table 13, available scene complexity is quite good and 
probably adequate for Idealized landing scenarios. For example, the VITAL 
IV system with 250 polygons per scene and 25 possible automatically acces- 
sible scenes allows for over 6000 polygons. In developing a terrain data 
base we could assign, say, 2000 polygons to composing the general terrain 
contour, and use the other 4000 to generate stylized buildings and trees. 

Advances in CGI techniques are currently proceeding rapidly. While 
the surfaces in the Table 13 systems are uniform planes, Marconi Radar 
Systems now offers a daytime CGI which can generate surface texture 
(Ref. 77). 
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TABLE 13 


COMPUTER-GENERATED INFORMATION DISPLAYS FOR VISUAL FIELD GENERATION 



RIGHT 

MT 1 

Hcc«ncUtur«i 

tovovicu (OOH 

Vital III 

Eta Day/Rlght CQX 

VlUl IV 

TEPICER (reievlaloa Pletura CQIeratioc) 

COWV-SCDIE 

Venlor: 

Radlfoa 

HcDonnell Douglaa 
Electrofilca Co. 

Svana b Sutherland 

HcDonnall Douglat Elaetronlca Co. 

Marconi Radar SyataM ltd. 

Oanaral nactrla Coagnny 

lion* orricti 

Gravity, Sutccc, UK and 
Arlington, Taiaa 
Itanufaciurad by Evana b 
Sutherland, Salt Lakt 
City, Utah 

St. Charlaa, K> 

Salt Uka City, Utah. 

St. Charlaa, K). 

Chalnaford, UR 

rt. Uuderdata, Pto. 

Prlet RangtT 

Uale dapaivUn« 
on optica, aajnK>rt» 
intarfact raqtdrant&U, 
ate. 

|2b2R baala ona dlaptay/ 
channel 

1330 - thrto channtl 

11.7 to 2 M 

$330K baale ona dlaplay/channal 
i60K per add. channel 
iCOK per add. dUpUy 
Cuaton Inter faca/lnaUllatlM 
•xtra 

t 53OK (ITOOK) 

4l.3-3.3H 

Typt of DltpUjr) 

CalUcraphle, btaia- 
panatratloQ color CRT* 
Virtual Inaca ^tlca 
optional 

CalUsraphle, baa». 

penetration color CRT* 
Virtual Inaga optica 

Color raatar tcaa, can dlaptay 
with noixltor or projector 

Calligraphic, bea**panatrailon 
color CRT* 

Virtual Ixnga optica 

Color raa ter aean, can dlepUy with 
nonlior or projector 

Raatar aean, full color 

Roth projected real tnagaa 
and virtual Inaga optica 

BrlchtMtit 

19 ft. L at dltplay cut to 
t/6 through baajMipllttar 

*•3 ft. t 

20 ft. L 

-23 ft. L 


-6 ft. 1 

Fitld of Vl*wt 

37* vart. by bS® horU* 
Batlc ona ehaimal 

30* vurt. by 36® hort*. 
Optlona up to -.ISO 
borls 


)0® vart. by 3^ t»ft* 
Optlona up to otjO horli 

t vert, by 120* horlt wtth 3 are nU 
raaolutlen 

Virtual ItMga 32* vart. by 
30® l«>ria. 

Projected 60® by 60® 

MaLnua Kunber of 
Chauielj/CoatroUtrt 

Z 

3 

3 

3 

3 


I * T * I Adlrtttnblt 
Locailons/Dltplny: 


b096 • b09fi • f 


b096 • 1096 * 1 



Scant CcMplMltyt 

Coco point Ughta plua 
6b polygona baale (can 
aapaod to 236) 

Surfacaa art iKinochroaM 
fog, SCUD, and cloud laytrt 

600 point Ughta plua 
runvay alanenta, fog, 
SCUD, and cloud layera. 

2000 point Ughta, boo polygooa, 
1600 varticaa, convex ax:d 
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E. IMA(Z PBESENTAXION OPTICS 


The Image, once generated, must be presented to the pilot via some 
combination of optics and screens; and this Is the Interface we are con- 
cerned with. 

Two main alternatives for vlsxial presentation follow. 

1. CRT and Wide-Angle TV 

A large, fixed-screen, front-projection system Is arranged some dis- 
tance In front of the cockpit (e.g., the Noralr simulator). The projector 
Is usually over or behind the cockpit. The projection screen may be pre- 
dominantly In front of the cockpit for normal aircraft or STOL vehicle 
simulation, or It may extend downward more In the case of VTOL or heli- 
copter aircraft. The viewing angle of the CRT Image may be enhanced by 
projecting the CRT Image on a wide screen using closed circuit projection 
TV. Figure 7 Illustrates such a system using the Advent projection tele- 
vision system. 

2. CRT and Collimating Lens 

A "simulated window" Is presented using a cockpit-mounted, collimated 
CRT monitor (or rear-projected television), e.g., as In the NASA Ames 
Research Center SOS Flight Simulator and Flight Simulator for Advanced 
Aircraft. More than one simulated window unit may be provided (e.g., one 
each for the pilot and copilot) or additional windows may be required for 
cases where parafoveal viewing Is Important. The CRT line graphics can 
yield an abstraction of the visual scene which provides an Interactive 
"outside" visual reference sufficient for guidance and control tasks. 
Equipment requirements are modest, changes are easily made, and costs are 
low. The apparent realism can be enhanced using a collimating lens. 

The real-world visual scene Is tens to hundreds of feet In front of 
the pilot. Thus when he moves his head the scene does not change In azi- 
muth. On the other hand, a rear-projection screen. If used Instead of a 
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Figure 7. Example of Wide-Angle Projection TV System for 
Presenting a Visual Field Appropriate to 
Night Operations 
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directly-viewed CRT, needs to be kept close to the cockpit to minimize its 
size and space requirements. Thus a viewing distance of at least 8 to 
10 ft is required for a plain screen with rear-projection. To provide a 
more distant focus and accommodation angle of the eyes, a faraway virtual 
image can be generated by a "collimating" lens placed near the pilot's 
eyes, or by a larger spherical mirror reflecting the source image. 
Subjectively, collimatlon does appear to enhance realism, but it raises 
problems of lenses in the cockpit, limited exit pupil, and how to handle 
the framing elements. These problems are not serious, however, in a fixed 
base application. 

Table 14 lists some of the considerations favoring one or the other of 
these two basic schemes. The comments are based on several years of 
contact with various aircraft manufacturers, MSA installations, and 
visits to a few of the visual simulation installations in Europe (notably 
those at British Aircraft Corporation, Wharton, England; SAAB Aircraft 
Company, Llnkoping, Sweden; and KTH, Stockholm, Sweden). 

References 44 and 83 present results from an experiment which 
attempted to provide a direct measure of the psychological realism from a 
computer graphics night visual generator. The measure of realism is based 
on Gilinsky's research concerning the effect of instructions to the sub- 
ject on the perception of size (Ref. 19). These and other results 
examined in Appendix A suggest . that collimatlon contributes to the per- 
ceived realism of the generated visual scene when compared with direct 
viewing of a comparable scene on a CRT display. 

References 63 and 64 also describe some of the tradeoffs concerning 
the choice between collimatlon or front screen projection for presenting a 
generated visual field on several TV display systems. From the objective 
landing approach and touchdown performance measures as well as their sub- 
jective confirmation by trained commercial pilot. Refs. 63 and 64 conclude 
that a collimated monitor appears to be more satisfactory than a front 
screen projector for the television display system tested. This 
conclusion is qualified, however, by a recommendation for more study on 
changing the degree of collimatlon on the monitor or on collimating the 
projector, and comparing results so obtained with those reported in 
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TABLE 14 


CONSIDERATIONS FOR LARGE FIXED SCREEN VERSUS COCKPIT MOUNTED VISUAL FIELD SIMULATORS 


LARGE FIXED SCREEN AND CRT PROJECTOR 

• Limited to a single fixed Installation, due to 
large screen and floor area required* 

• Subjectively poor depth realism* (Refs* 19 
and 44)* 

• Can cover large visual angles, (if linear 
motions are limited)* 

• Viewing distance of 10 to 20 ft requires 
parallax correction for long range objects 

• If cockpit motion Is required, projection must 
be synchronized to cockpit angular and linear 
motions, with smooth, high-bandpass 
fidelity* Therefore flat screen must be much 
larger than desired field* 

• High-aculty large size CRT projection now 
achieved, especially with color* (Advent 
Projector) 

• Easy to Interpose various window occlusions, 
actual HUD devices, etc* 


• Cost: » $2,000 to $5,000 plus motion 

compensation system, if required* 


CAB-MOUNTED, COLLIMATED CRT MONITOR OR PROJECTOR 

• Can be mounted on any cockpit unit; multiple 
units feasible* 

• Subjectively more realistic depth cues* 

(Refs* 19 and 44)* 

• Limited visual angles, depending on aperture 
and viewing distance* 

• Requires large collimating lens 

• Perspective Is Inherently synchronized with 
cab motions* All of display field is 
utilized* Height of display unit adds to 
moving cockpit Inertia* 

• Hlgh-resolutlon raster or dot TV monitors are 
now available (1,0004* lines feasible and 
practical)* Satisfactory color CRT monitors 
are Imminent* 

• Hide angle simulations (± 30 deg visual angle) 
require collimating lens close to eye, which 
complicates simulation of framing and HUD 
devices* If lens-at-wlndow Is used to avoid 
this, larger lenses are required* 

• Cost: “ $3,000* 



Refs. 63 and 64. To the best of our knowledge » this further study and 
comparison has never been made at Ames Research Center. 

Our experience with "plain" screens versus "collimated" presentations 
(which put the scene's virtual Image at a far distance) Indicates that 
colllmatlon Is an almost mandatory requirement for "realistic” visual 
presentations. Two types of colllmatlon system have been used. Most 
American systems place the collimating lens In the windshield position, 
relatively far from the pilot's eyes, thereby limiting the field of view 
to the order of ± 15 to ± 20 deg. The European systems put the colli- 
mating lens very close to the pilot's eyes, thereby permitting visual 
fields of ± 30 to ± 40 deg. The former arrangement permits Inserting 
various head-up display devices between the pilot's eyes and the colll- 
matlon lens, while the latter system requires generation of such devices 
via either a half-silvered Inclined mirror In the optical path between the 
colllmatlon lens and the projector or by electronic superposition of sym- 
bols. Both schemes should be carefully considered In the light of other 
requirements before final selection Is made. 

Keeping In mind that the early MVSRF generation problems will concern 
conventional transport aircraft problems, that conservation of floor area 
Is desirable, and considering that large, economical collimating lenses 
are now readily available — we believe that a cockpit-mounted "simulated 
window” visual display system with CRT and collimating lens Is 
preferable. Predominant considerations for the facility are the versa- 
tility afforded by the small, lightweight units (which can be mounted In 
front of the pllot-copllot on any flight deck, as required), the ease of 
eventually using the visual display system In conjunction with a moving- 
base system, and the minimal physical space reqtilrements of the simulated 
window concept. 

F. UPDATE RATE 

A usable Interactive visual landing display must appear smoothly con- 
tinuous, l.e., have no "strobing" (stopped or reversed travel of discrete 
scene elements which contribute visual "streamers") or "flicker," and it 
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must respond to pilot control inputs without any noticeable computational 
delay (i.e*, with less than 0*04 sec delay). 

Flicker (flashing of the drawn scene) is avoided by maintaining a 
display refresh rate well above the pilot *s critical flicker fusion fre- 
quency. An effective refresh rate of 60 fields/sec was originally 
selected by the television industry to avoid flicker problems. Given this 
video refresh rate, we must then appropriately update the CRT portion of 
the raster scan converter to avoid strobing or Interference between the 
CRT update rate and the video refresh rate. When the update rates are not 
synchronized, tests have shown that the CRT update rate must be on the 
order of 100 times/sec to avoid strobing effects with the 60 Hz video 
rate. 

Given that one has achieved a flicker-free display, then the question 
arises as to how often the scene composition is updated. Motion picture 
experience would suggest that 24 frames/sec is a lower bound on update 
rate in order to achieve the appearance of smooth motion. However, high 
image motion will be recorded on film with some blur due to the nominal 
1/50 sec shutter speed used in a typical movie camera, and the recorded 
blur helps to give the illusion of continuous motion. Computer-generated 
imagery does not have the softening effect of this blur characteristic, 
and thus requires somewhat higher scene update rates to appear 
continuous. Update rates of 30 scenes/sec are marginal, and 60 scenes per 
sec would be desirable to be consistent with the video refresh rate. 

Computational delay, or the minimum time between a control action and 
subseqtient display motion, is the final critical characteristic of display 
quality. As far as the pilot is concerned, delays in scene computations 
are Interpreted as delayed vehicle response. Such computational delays in 
scene update are subjectively very annoying, and increase operator mental 
workload even when effects on performance (accuracy of control) are not 
readily apparent. Recent aircraft research (Ref. 78) has shown that de- 
lays on the order of 0.05 sec cause a degradation in pilot rating of 
vehicle response of one unit on a 10 point scale, which is a rather severe 
penalty for a simulation artifact. 
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In most CGI systems the scene update rate and computational delay go 
hand In hand, since the scene can be updated only when the computations 
are completed. This double effect makes computational delay a critical 
factor. Thus 0.04 sec for the combined computational delay of vehicle 
equations of notion and display scene content represents an upper bound. 
Exceedence of this upper bound can be expected to cause penalties In simu- 
lation fidelity and unrealistic psychomotor workload In precision landing 
tasks. 

G. SUMMARY 

In summary, our recommended visual field display system (from the 
pilot Interface point of view) is a cockpit-mounted ‘'simulated window,” 
using a reasonably large collimating lens near the pilot's eyes. The 
exit-pupil should be at least 1 ft diameter, and the virtual image should 
appear further away than 40 ft. The image source should be a high quality 
(1000+ TV line, 21 inch) CRT. If the probability of vertigo is to be only 
"occasionally," an image source having aspect ratio (wldth:helght) 2:1 
should subtend not more than 80 deg wide by 40 deg high at the viewer for 
landing operations. The width of the field of view can be allowed to 
exceed 180 deg to encompass the entire windscreen for airborne traffic 
detection studies. As long as the 180 deg visual field remains impover- 
ished, the probability of vertigo will remain only "occasionally." 

The choice of visual field display for the MVSRF depends on many fac- 
tors: program design objectives, equipment availability, reliability, 

maintenance requirements, software requirements, and cost. Considerations 
of reliability, maintenance, and cost certainly favor the relatively 
simple collimated CRT with a monochrome night visual graphics system, but 
subjective pilot ratings of realism favor the inclusion of color capabil- 
ity at modest Increase in cost for night visual graphics. 
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SECTION IV 


MOTION CUES 


In establishing requirements for the simulation of cockpit motion, 
consideration must be given to the effects of motion cues on: 

• Tracking 

• Failure detection 

• Discrete maneuvers 

• Illusions and disorientation 

Our discussion of each of these topics will be based on research reported 
in Refs. 52, 53, and 79. 

A. TRACKING 

With regard to tracking performance, it is generally more Important to 
have the rotational cues than the translational ones. If tracking perfor- 
mance were the sole criterion, the translational motions might even be 
eliminated altogether as long as the task did not require a translational 
acceleration feedback which had no visual equivalent. Nevertheless one 
must be cautious about providing only angular motion cues in a simulator 
(which are potentially useful to the pilot), but which are not present in 
actual flight without corresponding specific forces which accompany 
translation. 

However, as we will see shortly, there are other arguments for includ- 
ing translational motion besides their effects on pilot tracking. If the 
translational motion is provided, then from the tracking standpoint, we 
can establish a desirable frequency range to reproduce the motions. This 
range would be on the order of 0.5 to 5 rad/sec. The higher frequency 
cutoff for the translational motions is less than that for the angular 
motions because of the much lower bandwidth of the vestibular sensors, the 
utricles. 
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There Is one other aspect of the translational motions which should be 
considered with regard to the tracking tasks. In certain rare situations, 
such as storm penetration, the translational motions can be severe enough 
to Interfere with the pilot's tracking by either degrading his ability to 
see the vlsxial display or by degrading his ability to manipulate the con- 
trols In the desired manner. In this situation the translational motions 
are affecting the tracking, not In that they are providing a cue, but In 
that they are Interfering with the task. 

On the other hand, the rotary motions should be faithfully reproduced, 
at least over an appropriate frequency range. A reasonable high frequency 
limit Is 10 rad/sec. This Is the bandwidth of the vestibular sensors. In 
this case, the semicircular canals, and Is considerably above any manual- 
control crossover frequencies. For the low frequency limit. It does not 
appear necessary to go as low as the vestibular sensor washout, roughly 
0.1 rad/sec. A conservative lower frequency limit would be 0.5 rad/sec 
and even 1 rad/sec would be reasonable. 

Tracking requirements are also affected by controlled element dynam- 
ics. For an easy control task, one requiring little pilot lead 
equalization, the effects of motion cues are considerably less than for a 
difficult task, one requiring large pilot lead equalization. Fixed-base 
results may be completely adequate, although slightly conservative, for a 
vehicle with good handling qualities. On the other hand, fixed-base 
results for a vehicle with poor handling qualities or a marginally con- 
trollable task will be overly conservative. 

The following procedure should be used to estimate motion simulation 
requirements for a specific tracking situation: 

• Define the system piloting task, vehicle dynamics, 

displays, Inputs, and disturbances 

• Determine potential visual and motion feedbacks for the 
task 

0 Analyze the flight situation using the Multlmodallty 
Pilot Model and. If necessary, the Multlloop Pilot Model 
(Ref. 14) 
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e Reanalyze with a variety of simulator dynamics Included 
(e.g». Ref. 80) 

• Determine limits of simulator dynamics for acceptable 
performance degradation relative to flight. 

B. FAILURE DETECTION 

The second consideration affecting motion simulation fidelity require- 
ments Is failure detection. If the piloting task Includes recovery from 
an aircraft, rotorcraft, or system failure, such as an engine or stability 
augmentation failure, motion cues can play an especially Important role as 
alerting cues. The motions accompanying a failure can help greatly In the 
pilot's timely detection of the failure. This Is especially true If the 
visual modality Is already heavily loaded with a demanding task. For 
example, a hardover elevator due to a pitch damper failure could be de- 
tected by the normal acceleration and pitch rate motion cues before 
noticeable effects were displayed on the flight Instruments (such as the 
artificial horizon). 

At present no general requirements based on failure detection are 
available. As a minimum, the motion should be enough to provide an unam- 
biguous clue to the failure. For example, to simulate a hardover yaw 
damper malfunction, the simulator should have enough lateral travel so 
that the pilot can clearly separate the lateral acceleration cue accom- 
panying the failure from those due to gusts. In many cases failure 
detection may put the most stringent requirements on translational mo- 
tions. 

In one experiment at NASA Ames Research Center, flight In gusty air 
was simulated and various amounts of lateral travel on the slx-degree-of- 
freedom simulator were utilized. It was found that with very limited 
travel, the pilot could not differentiate between an englne-out and a side 
gust. In fact, with the very small travel, 4 Inches, the pilot could not. 
In some cases, even determine the direction of the Initial acceleration. 
The pilot just experienced a sharp side Impulse, but was imable to deter- 
mine the direction. 
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A technique for reducing the amount of linear travel required has been 
suggested. This technique Is to scale down the linear accelerations from 
those which will be experienced In real life. Scaling down the accelera- 
tions by some factor would, of course, also scale down directly the linear 
travel requirements. Conceptually this sounds like a reasonable approach, 
but Its validity has not been thoroughly established. 

It should be clear by now that It Is extremely difficult to establish 
accurately the linear travel requirements for the simulator. Given a 
specific situation. Including a specific vehicle and flight condition, one 
cotild probably estimate with reasonable accuracy the requirements for that 
task. On the other hand, to cover the many combinations of missions and 
vehicles for which the simulator will be used, the best we can do Is make 
some rough estimates. If we take a reasonable acceleration level, like 
0.1 g, and assume that this acceleration must be maintained for the order 
of 1 to 2 sec, which Is typically the sort of time required for the pilot 
to react to a failure, then we come up with travel requirements on the 
order of ± 5 to d; 10 ft. 

Before leaving the subject of failure detection, we should also point 
out that while the linear cues are Important In detecting the failure, the 
angular cues can be very significant in the subsequent recovery 
maneuver. This would be especially true for a failure of the stability 
augmentation system. Then the pilot would be faced, not only with a large 
transient Input, but with a sudden degradation In vehicle dynamics. In 
this situation the angular motion cues would probably be of critical Im- 
portance In simulating the recovery operation. ■ 

C. DISCRETE MANEUVERS 

The third consideration affecting motion simulation requirements Is 
providing realism during large discrete maneuvers. Examples of the sorts 
of maneuvers we are considering here are sustained turns, pull-ups, and 
translation from one spot to another In a hovering vehicle. For this 
class of maneuvers, accurate duplication of linear motion cues Is Imr 
practical. Duplication of sustained linear accelerations In a ground- 
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based simulator becomes an extremely costly proposition. The cost 
Involved cannot be justified on the basis of the added realism. A prac- 
tical solution Is to provide a limited amount of linear travel and to 
restrict the maneuvers which the pilots are allowed to perform on the 
simulator. With limited linear travel, the pilots could do short duration 
discrete maneuvers. On the other hand, they should be prevented from 
trying long duration maneuvers when the linear motion system Is 
operating. The Idea here Is that motion cues are better than the wrong 
cues. 

Two specific problems which compromise the pilots' Impressions of 
realism are false translational accelerations and washout effects on open- 
loop maneuvers. An example of the first would be roll control In a simu- 
lator with roll motion but no lateral travel. When the subject rolled the 
simulator he would sense a proportional lateral acceleration because of 
gravity, whereas In an airplane the perceived acceleration Is generally 
very small (e.g., the turn Is "coordinated")* Not only may the false cue 
affect the pilot's control behavior, but It will surely Influence his 
subjective opinion of the simulation realism. An example of the washout 
problem would be a pull-up maneuver In a simulator with limited vertical 
travel. The Initial acceleration would be correct but, because of the 
limited travel. It would be necessary to reverse the acceleration 

quickly. The reverse acceleration Is In the opposite direction to that 
being commanded by the pilot and certainly could be confusing. Thus wash- 
out characteristics, which might be completely masked In a tracking task, 
could become quite obvious In certain open-loop maneuvers. 

Another Item should be mentioned In this regard, and that Is the 

utilization of gravity to lower the linear travel requirements. By ro- 
tating the simulator and visual display at angular rates below the pilot's 
threshold, one can reorient the pilot and make use of gravity to provide 

the sensation of a sustained fore and aft or lateral acceleration. 

Figure 8 Illustrates how this concept might be mechanized. 

A series of moving-base flight simulator experiments has been recently 
performed using roll and sway motions of the Large Amplitude Multimode 
Aerospace Research Simulator (LAMARS) of the Flight Dynamics Laboratory at 
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Figure 8. Low Frequency Corrections for Gravity 
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Wrlght-Patterson Air Force Base, Ohio (Ref. 79). The accompnaylng visual 
scene provided only the rolling degree of freedom for the pursued and 
pursuing aircraft with respect to an impoverished homogeneous background 
with no visible horizon. The objectives of these experiments were: 


1. To tie in the roll-only visual-and-motion simulation 
results of the four experienced pilots with previous 
results (Ref. 81) for four well-trained nonpilot sub- 
jects. 

2. To investigate effects of various lateral-beam-motion 
’’washout” filters designed to keep the lateral sway 
within the ± 10 ft of LAMARS travel. (Lateral beam sway 
is used, within limits, to imitate the realistically 
“coordinated" lateral motions of free-flight roll 
maneuvers.) 


The high-pass washouts on lateral beam travel (y^jggjj) were of the 
general form: 


beam 


^free flight 


K s‘ 

Z 

2 2 
s + 2 r 0) s + 0) 
y y 


where Ky « attentuatlon factor, coy “ high-pass break frequency (r/s), and 
5 y = 0.70 (fixed). 

Values of Ky and Uy were explored, fraa which example data will be 
shown subsequently. A nonlinear (time varying) washout was also tested in 
which u)y was continuously adjusted in accordance with the smoothed magni- 
tude of roll angle so as to permit correct cues for small roll activity, 
while reducing the lateral beam travel peaks for large roll angles. Re- 
shaping the forcing functions was also Investigated and shown to reduce 
travel requirements. 

The pilot's task was to follow an evasive (randomly rolling) target 
while suppressing gust disturbances (Ref. 81). A two-independent-input 
technique produced behavioral data (describing functions) and performance 
data (error and control scores), which revealed how pilots used the visual 
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and motion cues* Subjective data was also gathered on the tracking task 
as well as on limited ''sidestep'* maneuvers* Appendix 5 herein presents 
the results from Ref* 79* 

The main results in Ref* 79 show that: 


1* Both the pilots and previous well-trained non-pilots 
(Ref. 81) exhibited nearly identical behavior and per- 
formance, implying universality of adaptation and 
results* 

2* The pilots* roll tracking behavior and performance were 
not significantly affected by a variety of lateral-sway 
washouts* 

3. The nonlinear lateral washout filter reduced the peak 
lateral travels at the expense of occasionally greater 
lateral-specific-force (a ) peaks, but otherwise did not 
affect behavior or perfomance* It promises to provide 
an adaptive washout which does not need to be itera- 
tively fine-tuned to avoid hitting stops while 
minimizing spurious washout artifacts* Additionally, it 
should be especially useful during training, where 
motion cue usage is changing* 

4* Both sidestep and random tracking maneuvers gave rise to 
spurious lateral motion cues (the coordinated free- 
flight case would have none) which were characterized as 
"out-of-phase," "like a student on the rudder pedals," 
etc* Analysis showed these to be roughly correlated by 
time- and frequency-response parameters related to sway 
washout gain, K , and frequency, ^ • Combinations of ¥y 
and ^ were identified which provided the most accept- 
able Impressions of roll and sway motion realism* 


D. ILLUSIONS AND DISORIENTATION 


The final factor we wish to consider is that dealing - with illusions 
and pilot disorientation* Here we have assumed that "real-world" illu- 
sions are not to be intentionally duplicated in the simulator* The reason 
for this is that the majority of these illusions require sustained angular 
rates or linear accelerations* Consequently the ability to duplicate 
these motions would be very costly, and there already exist special pur- 
pose devices which are available for investigating these problems. The 
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problem we are concerned with here is how to avoid any artificial illu- 
sions which might be introduced by the limitations of the simulator 
dynamics. 

The main difficulty here is any discrepancies which might arise 
between the visual and motion senses, especially for the case of simulated 
visual flight. The problem of vertigo was discussed in Section III in 
connection with the visual field of view of a fixed base simulator. An 
example of this is reported in Ref. 84. In those experiments, a fixed- 
base simulator with a wide angle projection system was used to simulate a 
hovering VTOL. If the pilot made rapid maneuvers with large angular mo- 
tions, he became nauseated after a short period of time. The conflict 
between the visual presentation which told the pilot he was rotating 
rapidly in space and his lack of vestibular cues was apparently the 
cause. Apparently the magnitude of the angular motion is one of the 
governing factors here. (The other governing factor is the field of view 
of the visual display as discussed in Section III.). On the one hand, 
there have been a number of fixed-base simulations of transport landings 
with similar displays in which there was no problem. On the other hand 
there have been many fixed-base simulations of Instrument flight with 
large angular motions in which there was no problem of nausea either. 

These results lead one to conclude that if the simulator is to be used 
for visual tasks in which there would be large angular motions, e.g., a 
sidestep maneuver for the purpose of collision avoidance on a landing 
approach with parallel runways*, it would be necessary to have the angular 
motion cues, and some limited translational motion would also probably be 
helpful. This could be a very significant factor in the motion simulator 
design, in that one would have to have the capability of providing at 
least the angular and limited translational motions for the sidestep while 
utilizing the visual display. For the majority of operations with limited 


* The side step maneuver during landing is discussed in Ref. 82. A 
typical upper bound on roll attitude is 40 deg, whereas maximum roll rate 
is only 20 deg/ sec. 
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forward view, motion cues are probably not so critical from the illusion 
standpoint as from other (e«g«, tracking) and failure detection 
considerations. 

E. SUMMARY 

Fidelity requirements for the simulation of cockpit motion depend on 
the psychomotor role of motion cues in tracking and failure detection 
tasks as well as on the pilot's impressions of realism. 

With regard to the pilot's tracking performance and behavior, it is 
generally more important to reproduce correct rotational motion cues over 
an appropriate frequency range which will be predicted from validated 
analysis of the specific tracking situation using the Multimodality Pilot 
Model and, if necessary, the Mtiltiloop Pilot Model. Nevertheless one must 
be cautious about providing only rotational motion cues in a simulator 
(which are potentially useful to the pilot) but which are not present in 
actual flight without corresponding specific forces which acccmpany 
translation. 

The simulation of motions accompanying a failure will help greatly in 
the pilot's timely detection of the failure. This is especially true if 
the visual modality is already heavily loaded with a demanding task. At 
the very least the motion should be sufficient to provide an unambiguous 
clue to the failure. In many cases failure detection may put the most 
demanding requirement on translational motions. 

Two specific problems which compromise the pilot's impressions of 
realism are false translational accelerations and washout effects on open- 
loop maneuvers. Roll motion without sway motion provides an exaggerated 
proportional gravitational component of lateral acceleration which is 
unrealistic. An example of the washout problem is provided by a pull-up 
maneuver in a simulator with limited vertical displacement. Although the 
initial acceleration would be correct, it would be necessary to reverse 
the acceleration unrealistically because of the limited travel. 
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Roll and sway motion cues have recently been Investigated with the aid 
of the Air Force Flight Dynamics Laboratory' s Large Amplitude Multimode 
Aerospace Research Simulator (LAMARS). Various linear and nonlinear sway 
motion washout filters were designed and tested to keep the sway displace- 
ment within the ± 10 ft of LAMARS travel. The main results from this 
Investigation show that: 


• The pilots' roll tracking behavior and performance were 
not significantly affected by a variety of lateral-sway 
washouts. 

* The nonlinear lateral washout filter reduced the peak 
lateral travels at the expense of occasionally greater 
lateral-specific-force (a„) peaks, but otherwise did not 
affect behavior or perfomance. It promises to provide 
an adaptive washout which does not need to be itera- 
tively flne-ttmed to avoid hitting stops while 
minimizing spurious washout artifacts. Additionally It 
should be especially useful during training where motion 
cue usage Is changed. 

o Both sidestep and random tracking maneuvers gave rise to 
spurious lateral motion cues (the coordinated free- 
fllght case would have none) which were characterized as 
"out-of-phase," "like a student on the rudder pedals," 
etc.' Analysis showed these to be roughly correlated by 
time- and frequency-response parameters related to sway 
washout gain, K^, and frequency, u . Combinations of IL. 
and u were Identified which provided the most accept- 
able impressions of roll and sway motion realism. 


F. RECOMMENDED MOTION SIMULATION SYSTEM 


Based on the foregoing considerations a specific set of motion-cue 
requirements has been derived and Is presented In Table 15. 

The basic system should be a f Ive-degree-of-freedom system (vertical 
and lateral translation; pitch, yaw, and roll rotation). We believe that 
for the applications of the MVSRF, there is not enough need for longi- 
tudinal motion cues to justify six degrees of freedom. The main loss 
would be transient axial accelerations accompanying reverse thrust or 
spoiler operation, and these could be simulated by rotating the cab 90 deg 
In yaw so that lateral translation becomes axial translation. Steady 
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TABLE 15 


MOTION SYSTEM DESIGN REQUIREMENTS 


Degress of Freedom 

Vertical 

Lateral 

Pitch 

Roll 

Yaw 

Travel: desired 

± 10' 

± 10* 




(min) 

(± 5') 

a 5') 

(± 30°) 

(± 45°) 

a 30°) 

Frequency Responses 
at 50% travel: 






a. Flat to: 

1 Hz 

1 Hz 

2 Hz 

2 Hz 

2 Hz 

b* Effective 
time delay 

<0*2 sec 

<0.2 sec 

<0.1 sec 

<0.1 sec 

<0*1 sec 

c. Damping of 
main modes 

C > 0.5 

C > 0.5 

C > 0.5 

< > 0.5 

C > 0.5 



climb or dive axial accelerations could be simulated by tilting the cab, 
as Is done for steady transverse acceleration (e.g*. Fig. 8). 

The toughest requirement Is for ± 5 to ± 10 ft of translation, with a 
very smooth drive, and flat. As shown In Table 15, the required mlnlmtun 
angular travels vary from 30 deg In pitch or yaw to 45 deg In roll, with a 
bandwidth reqtilrement of 2 Hz. Minimizing the motion simulation lags Is 
much more Important than matching amplitudes In the region of human ves- 
tibular response frequencies. About 0.1 sec of net lag Is specified, 
based on our experience with various simulators. Adeqtiate load stiffness, 
weight compensators, and excess hydraulic drive capacity can help to re- 
duce motion lag. 

The drives must be very smooth and as noise-free as possible. 
Spurious vibrations and bending modes should be avoided by adopting a very 
light, rigid structure and avoiding large cantilevered masses (such as the 
Noralr arm). Pilots are quick to detect any hydraulic drive noises which 
offer cues to the true simulator motion, so these must be minimized by 
acoustic Isolation and damping, or by masking earphone noise. 

We envision a pair of very light flight decks, each with Its own 
"simulated window” visual display, which can be placed on the motion plat- 
form or used as fixed-base simulators. The motion system should be 
arranged to fit this concept. Including the ability to rotate the cab in 
yaw for axial motion Investigations. The coordinates of the rotation 
system should match the Euler angle conventions of the equations of 
motion. This will reduce the need for complex resolving operations. 
Provisions should also be made to adjust the Instantaneous axes of rota- 
tion through a wide range. 

More detailed quantitative requirements cannot be generated until a 
specific motion system concept Is laid out. It Is suggested that a motion 
system with vertical and lateral tracks mounted on a wall might be a good 
starting point for the next phase of this problem. 
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SECTION V 


ASSESSING THE FIDELIT7 OF VEHICLE 
AND ENVIRONMENTAL MODELS 


The problem of assessing the fidelity of dynamic vehicle and environ- 
mental simulator models lies in knowing what essential features produce 
correct system performance and, in the case of a piloted simulation, what 
features induce correct pilot behavior. It is these essential features 
which then must be checked using the best available information. 

We must recognize that fairly complex simulator models are used at 
Ames Research Center for describing aircraft operating over wide ranges of 
flight conditions and loading configurations. But simulator model com- 
plexity, by Itself, does not automatically guarantee fidelity, although it 
does escalate digital computation requirements for processing speed and 
storage. In fact, a complex model may tend to discourage validation at- 
tempts because it calculates the physics Instead of simulating the 
physics. Our approach to model validation, however, allows us to work 
with a complex model having many degrees of freedom and non-linearities, 
but only because we effectively reduce complexity to the essential fea- 
tures mentioned above. 

This is a practical concept for three reasons. First it involves 
consideration of a reasonable number of numerical quantities — say less 
than a dozen. Clearly validation of literally hundreds and sometimes 
thousands of simulator model parameters is simply impossible. It is far 
more effective to look at the net results which are of practical conse- 
quence to the pllot-in-control. 

The second reason for considering only the essential model features is 
that it forces the simulator user to understand thoroughly his models by 
systematically reducing the model complexity to a point which is easily 
manageable. 

The third reason for considering only the essential model features is 
that the reduced complexity of the model can, in turn, reduce the digital 
computation requirements for processing speed and storage. More will be 
said about this in Section VI. 
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We should note that the approach described here has been used success-- 
fully in connection with powered-lift certification, specifically, the 
development of proposed certification standards (Ref* 85)* In order to 
formulate meaningful metrics it was necessary to reduce the complex models 
of powered-lift aircraft and their operating environment to more manage- 
able forms* This, in turn, exposed the features which really mattered in 
a given situation, and led to direct determination of numerical tolerances 
on fidelity of the vehicle and environmental models* 

Also the determination of essential features has been applied to heli- 
copter dynamics modeled via the Bell C-81 Rotorcraft Flight Simulation 
Computer Program (Ref. 86). This specific application produced direct 
measures of basic attitude and heading control, pitch-roll cross-coupling, 
turn coordination, velocity and position control, and gust/wind-shear 
sensitivity* In each case there were found to be three or fewer essential 
features which defined the particular phenomenon of interest. It is these 
few features on which one would concentrate to demonstrate simulator model 
fidelity* 

The following paragraphs describe this approach to assessment of simu- 
lator model fidelity by considering two useful examples* These examples 
involve the combination of pilot, vehicle, and wind environment* They 
also apply to. the situation involving an autopilot in place of the human 
pilot* Further they apply to real time or nonreal time simulation* 

Briefly stated, we view assessment of model fidelity by systematically 
reducing mathematical model complexity of the pilot (or autopilot), 
vehicle, and wind disturbance combination for a given condition* One 
example of this reduction process may begin with Step 1 following and 
proceed through Step 3* 

Step 1, Full blown simulator model consisting of: 

— Non-linear aerodynamics 

— Complete autopilot and stability augmentation 
description 

— Standard non-linear wind shear hazard and random 
turbulence model 
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Step 2, Linearized but high order coupled longltudlnal- 
lateral-dlrectlonal models of Important components 
including pilot actions with: 

— Six or more degrees of freedom of vehicle aero- 
dynamics 

— Linearized autopilot and stability augmentation 
including actuator and sensor dynamics 

— Wind separated into linearized deterministic and 
linearized random components 

— Linear pilot model of inner loop attitude and 

heading control and outer loop velocity or posi- 
tion control 

Step 3, Lowest possible order combined pilot (or autopilot), 
vehicle, and environmental model with: 

— Cross coupling and high frequency effects appro- 
priately embedded 

— Only significant disturbance components 

— Three or fewer degrees of freedom in essential 
feature descriptions. 

To be more specific, consider the cases of an aircraft operating IFR 
in a severe wind environment. Further let us concentrate on longitudinal 
vehicle performance in terms of altitude and airspeed. The question then 
is: what are the essential vehicle and environmental features which 

should be checked in the simulator? 

A. SIMPLIFIED CTOL PILOT-VEHICLE DYNAMICS 

The key to describing the predominant effects of wind shear on air- 
craft motion is to utilize pitch-constrained equations of motion. In 
effect, we assume that the pilot can Instantaneously obtain any pitch 
attitude he commands, and that gusts have no effect on pitch attitude 
(l.e., pitch attitude is. Itself, an Independent control). These are not 
valid assumptions if one is concerned about pitching motion, per se, but 
they are reasonably valid if flight path and airspeed are the main concern 
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as In the case here* Further pitching motion can be handled as a second 
order effect within the simplified context, If desired. 


The detailed derivation of simplified pilot-vehicle dynamics is car- 
ried out in Appendix C of Ref. 86. The starting point, however, is worth 
stating here in terms of the following equations of motion: 
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Pilot »s CTOL 
technique 


or 
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-K u 
u a 


Pilot’s STOL 
technique 


The first benefit of this description is that we have vastly reduced the 
number of essential variables which describe even the linearized 
vehicle. Note that the airspeed and flight path motion due to attitude, 
throttle, horizontal gusts, and vertical gusts is dependent only upon the 
six parameters X^, X^, Z^, Z^, V, and «X^/Zg^ (X^ • V X^ and Z^ — V 
Each of these is easily estimated as demonstrated in Ref. 87. Two pilot 
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parameters are Involved, and K^. These are set directly In proportion 
to their respective control loop tightness as expressed by crossover fre- 
quencies, « and u . For the CTOL case: 


and 
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-Kd^a 
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The altitude response due to horizontal and vertical gusts can be 
expressed in the following generic forms: 


or 


and 
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and 


2CjO>, * -X -Z 
d u w 


These expressions can be sketched in terms of asymptotes for the amplitude 
response to horizontal gust velocity, u , horizontal gust acceleration or 

O 

rate of shear, u^, and vertical gust velocity, Wg, as shown in Fig* 9. 
Accordingly altitude response to horizontal wind shear is inversely pro- 
portional to: 


• Airspeed, V 

• Airspeed loop tightness (uu ) 

u 

2 

• Square of flight path loop tightness (w ) 

^d 

for the spectral region extending out to the flight path regulation mode 
at frequency Altitude response to vertical gust velocity is inversely 

proportional to: 

/ 

2 

• Square of flight path loop tightness (u ) 
and directly proportional to: 


• Heave damping, Z^, which, in turn, is proportional to: 


• Airspeed, V 

• Lift curve slope, C, 

and inversely proportional to: 

• Wing loading, W/S (Refer to the definition of 2^ in the 
glossary.) 

These results will be useful for aiding in the Interpretation of an*- 
alogous results to be presented in the next topic. 
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B. SIMPLIFIED STOL PILOT-VEHICLE DYNAMICS 


The block diagram which describes the STOL piloting technique Is shown 
In Fig. 10. 

This Is reducible by direct multUoop analysis In which the manual 
crossover model for the pilot's STOL technique Is appropriately applied. 
(This also applies to the use of an autopilot.) If we were to concentrate 
on the essential feature of outer loop longitudinal— vertical control) one 
key relationship would be altitude or flight path sensitivity to longi- 
tudinal and vertical gusts*. The resulting essential-feature transfer 
function expressions are: 


and 
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A sketch of height response amplitude asymptotes is Instructive, 
therefore Fig. 11 is presented. 

The essential parameters in terms of vehicle and pilot /autopilot are, 
therefore: 


Vehicle: Z A function of airspeed which peaks at about 

20 to 30 kt but is relatively small else- 
where. Note that it determines basic height 
sensitivity to longitudinal gusts. 


* A counterpart to this example is given in Ref. 87 for conventional 
aircraft flying into large wind shears. 
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Heave damping which also Is a function of 

airspeed but Is always significant. It 
determines basic height sensitivity to ver- 
tical gusts as well as damping in the 
primary height response mode. 


Fllot/Autopllot: 


0 )^ Lower band limit to longitudinal gust sensi- 

tivity as well as contributor to effect 
(via product 


g 


Upper band limit to height response for both 

gust components and determinant of peak 
response for both gust components. 


The implications which the above relationships have for the atmos- 
pheric disturbance model are: 


• Only the u„ frequency content between and uv affects 
the simulator model. (Frequency content tends to be 
centered about the ratio of airspeed, V, to gust scale 
length, Ly.) 

• All w frequency content up to affects the simulator 
model? 

• Steady time dependent wind shears having a duration of 
more than l/o>^ seconds will affect the simulator model 
significantly. 

• Steady altitude dependent wind shears will have only a 

moderate effect unless is zero, i.e., there is no 

airpseed regulation. 


Finally the validation task is clear for the longitudinal-vertical 
outer-loop aspects of simulation. The task is simply to insure that the 
effective values of Z^ and Z^ are correct. These are directly obtainable 
from the simulator computer via perturbation of the z-force by airspeed 
and vertical velocity. Also each is relatively easily obtained from 
flight test data. If an autopilot is involved then and can be 
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easily determined from response to airspeed and altitude hold commands* 
For an actual pilot, ranges of likely and can be determined from 
existing experimental data (e*g«. Ref* 54)* Furthermore, the actual 
and demonstrated by the pilot in the simulator are relatively easily 
obtained by the measurement methods described in Ref* 2* 

€• SUMMARY 

To summarize the ideas in this section regarding assessment of vehicle 
and environmental model fidelity, let us return to the original concept* 
That is, we concentrate on validating only those essential features which 
produce correct system performance and induce correct pilot behavior* 
This vastly streamlines the validation procedure and forces the simulator 
user to understand very well what are the significant model components and 
features* The key to finding the essential model features is the reduc- 
tion of complex pilot-vehicle-disturbance models via existing multiloop 
system analysis methods* Finally the methodology for so reducing complex 
systems has been applied repeatedly and has attained a high level of 
refinement* 
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SECTION VI 


COMPUTER SELECTION CONSIDERATIONS 


A. DIGITAL SYSTEMS 

There are a number of commercial digital computer systems which are 
capable of performing the modular computational fimctlons described In 
Section I for the proposed facility. The function of each host computer 
described In the block diagram of Fig. 1 (In Section I) Is two fold: 
first, each host performs the designated aircraft or air traffic control 
simulation In real time, and second, each host provides essential Infor- 
mation from the aircraft or air traffic control simulation to the co- 
operating portions of the MVSRF described In Fig. 1, viz.; the flight 
decks; traffic controllers' and experimenters' consoles; and data acqui- 
sition systems. Reference 3 has already recognized that the substantial 
requirements for program development and real-time simulation are best 
satisfied by separate facilities; thus. It Is not Intended that any host 
computer will be burdened with tlmeshared or batch operations for program 
development. 

Existing host computer requirements In the Flight Simulator for 
Advanced Aircraft (Ref. 88) at Ames Research Center are provided by the 
Xerox Slgma-8 digital computer, some characteristics of which are listed 
In Table 16. References 3 and 5 claim to have analyzed existing flight 
simulation requirements and projected future requirements In arriving at 
the recommendations In the fifth column of Table 16 for each of the host 
computers In Fig. 1. Examples of ccxnparable commercially available digi- 
tal computers are also listed In Table 16. References 3 and 5 arrive at 
the conclusion that the DEC VAX-11 family compares very favorably with 
simulation computers at Ames Research Center and meets all of the stated 
requirements. The VAX 11/780, however, requires a floating point accel- 
erator In order to provide the execution times listed. Characteristics of 
dec's new VAX 11/750, which Is significantly less expensive than the VAX 
11/780, are also listed. It should be noted that the execution times for 
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TABLE 16 


COMPARISON OF SOME HOST COMPUTER SYSTEMS EMPLOYING 32-BIT WORDS 
WITH RECOMMENDED REQUIREMENTS FROM REFS, 3 AND 5 



Ames 

Research Center 





Type 

XDS 

Sigma 7 

XDS 

Sigma 8 

XDS 

Sigma 9III 
(Bldg 239) 

DEC 

PDP 11/70 

Recommended 
Requirements 
(Refs* 3, 5) 

DEC 

VAX 11/780 

DEC 

VAX 11/750 

Core Size 
(32 bit words) 

128K 

128K 

160K 

500K 

> 333K 

IM 

IM 

Key execution time 
(single precision 
floating point) 








Store (lis) 

2.6 

1.53 

1.53 

1.5* 

<1.5 

1.2t 

1.95 

Add (ys) 

3. 3-8. 2 

2.25-5.00 

2.25-5.00 

1.7* 


0.8t 

8.95 

Multiply (ys) 

6.0-8.8 

3.97-6.05 

3.97-6.0 

3.4* 

<2.0 

1.2t 

12.65 

Range of 
Execution 

Rates (Mega FLOPS#) 

0. 2-0.4 

0. 1-0.6 

0. 2-0.8 

0. 2-0.8 

“ 1 




* With FP lie floating point processor which runs under RSX-llM/FORTRAN IV-PLUS, 
t With floating point accelerator. 

§ Without floating point accelerator. Improvements with this are expected to be approximately 3 Ps for 

multiply and approximately 4 Ms for add. 

i? Million FLoating point Operations /Second (Ref. 5) 


t 




the VAX 11/750 are without a floating point accelerator. The likely im- 
provement on these times is given in the table footnote. 

As we mentioned in Section V, it is customary at Ames Research Center 
to employ fairly complex mathematical models for aircraft simulation over 
wide ranges of flight conditions and loading configurations. In the words 
of Ref. 5, it is customary to "calculate the physics explicitly, rather 
than to simulate the essential features of the physics." The reason 
usually given for this practice is actually misleading, viz., that simu- 
lator model complexity must inherently assure fidelity. Although (as 
mentioned in Section V) this practice certainly escalates digital computer 
reqiilrements for processing speed and storage, simulator model complexity 
is counterproductive because it discourages genuine attempts at valida- 
tion. Consequently we and others have repeatedly witnessed flight 
simulations with deficient fidelity, because it was taken for granted that 
the complexity of the mathematical model of the physics somehow assured 
fidelity, and there was not time to diagnose the source of the deficiency 
when some deficiency was discovered during training after the experiment 
was in progress. 

There is no need to employ complex mathematical models of the physics 
of flight in the MVSRF. Much simpler models which simulate the essential 
features of the physics will suffice. Examples of simpler models which 
have been validated are given in Refs. 89 and 90. Real time computations 
for these models can be accommodated in any of the 16-blt word mini- 
computers listed in Table 17 with processing time to spare for simulating 
the essential features of other aircraft systems and for providing real- 
time data acquisition. Before any computer is selected, however, a bench- 
mark simulation program such as that in Ref. 90, should be written and 
executed on each of the prospective candidates. Recommendations for or- 
ganization of the software are given subsequently in Section VII. 

Several factors involved in selecting computational module(s) from 
among possible candidates are summarized in Table 17 for some typical 
competing possibilities. One of these computing systems is the Varian 73 
which is employed in the VITAL III CGI system (Table 13, Section III). 
Another is the PDF 11/45 which is used in the Evans and Sutherland 
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TABLE 17 


COMPARISON OF MINICOMPUTER SYSTEMS 


EMPLOYING 16-BIT WORDS 


Sam; 

BDVA 312 

ECLIFSE 230 

PDP 1l/3b 

(see footnote for FOP 1l/b3s) 

VARIA3 73 

nmufacturart 

Data General Corp* 

Sata Seneral Corp* 

Digital Equipaent 


Price Range*: 

10-l40K$ 

21-91 

12-bbK$ 


Processor 

• Sira instroctioa sat 

202b 

202b 

boo 

139 

• Speed, access 

700 Bsao 

boo nsao effective* 

930 nsae 

660 nsec 

• Special hardware 

either Integer ailtiply/dlTlde 
or fleeting point 

parallel floeting point 

either integer aultiply/divlde 
or floating point 

floating point 
availabla 

• 5b* of general purpose 
registers 


b 

6 

3 

Memory 
• Word size 

16 bit 

16 bit 

16-18 bits 

16 bit 

• Memory size 

32-126 kwordi 

32-128 kuords 

32-128 kwords 

8-32 kwords 

• Other 

usee memory management 
end Bulti-eore-adapter, 
core-to-core transaetiODS 
at 1000 nsec 

uses memory interleaving, 
error checking, and 
correcting 

us as memory management 

dual port, or 
core sharing 
at 660 nsec 

1/0 Capability 
• Clock programmable 

y« 

yes 

yes 

yea 

• 5b. of Intempt levels 

a 

6b 

b, vectored 

6b 

• 5o. of parallel channels ; 

62 

62 

unlimited 

32 

Peripherals 

good IMttStry support 

good industry support 

Industry standard 
for most peripherals 

weak to 

moderate support 

Software 

• Operating system 

1 

. 1 

RDOS (E)^ 

RSOS (E)* 

ftr-11 (£), R3X*t1M(E) , BSI3/E (£ 

yes 

• Languages 

PORISAH (E), COBOL (E), BASIC 

rOSTBAH (I), COBOL (E), BASIC 

rORZRAH(E), £ASIC(E), COBOL(5) 

FCRIHAH, RPO 17 

• Peripheral controllers 

"SAJf, Fortran subroutines 

"SAM”, Fortran subroutines 

fortran extensions 

Vortex 

• dagnosties 

yes 


yes 

yes 

• Support, doaaientation 

Software Support, 
Reliability, Serdee 

good 

moderate- large volisne 

good 

moderate-large voluae 

good 

large number of reel- time 
applications in U>3. 
Serrlce contract <9 1 *3^ of pur- 
chase price per month 

fair 

moderate mu±cr of 
Laboratory applications 
but declining 


• Tbmsm prlcM loftwmr* but cxeluslv* of peristertil* aad Interfac* ^ ttotpt gin«r«Ily rtcdor* which jupply 

those at lower costs. 


Uses f^i BQ TT' istcrleavla^; lirtoger Bultlply/diTUt is sta nd a r d 

(x) Catasatlca, Vol. 2J, Ho. U, Dac., \ 9 (% "orcrall saa.sftcclon“ from ostr rating of loftwart packages, HS-Honor BoU, ©!-Honorabl« Meat ton, 
K-CccfUent, F-?air, O-Good. 

SoilSit »s! TtSJ jL'S;cS=st"j33*L« proc.,r ««« 

(ttnsle or dooblo proelJloa) floating point proctnor; up to 12« worn oenoiy; 3M “®* 

900 asac coraMJOir^wlto BSX-nD and -M raal^tlos nalU-usar and ESB/E tlaasharlijg optratlag systass. Howavar, tha 11/3^ offers 
raffideat 9 a»ry sisd spaad for AIDS appUeatio&s . 

' Owned by Uaivmc DtrLslon of Sparry-Rand Corp- as of July 1977- 
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Day /Night CGI System (Table 13). The common denominator among the two DEC 
and two Data General computing systems is the real-time operating system 
with high-level languages, good supporting documentation, and software 
diagnostics. All four of these computing systems also have become avail- 
able in moderate-to-large numbers of real-time and laboratory 
applications. To make a cost-effective selection among such alternatives 
we must consider the requirements xmlque to the real-time graphics genera- 
tion task in general as well as the computational needs pertaining to each 
functional subsystem. Some of these factors are discussed below. 

One concept which we have found useful in satisfying the computational 
requirements in experimental facilities is distributed processing. This 
allows modularization of computational and control hardware, whether 
hybrid (see later discussion) or digital, along fiinctional lines such that 
each module can at least partially function Independently. Our experience 
indicates that this can have many advantages, e.g.. 


• Parallel development . Hardware specification and pro- 

curement and software design and checkout can be done 
in parallel for each module. 

• Checkout . Independent design tests, routine diagnostic 

tests, and maintenance on both hardware and software 
are possible. 

• Reliability . Down time for the entire facility may be 

minimized. Failure of one computational unit might 
still permit the possibility of part-task operation 
of the system. 

o Flexibility. Changes in, additions to, and reconfigura- 
tions of the system are possible at lower cost than 
if the total system is centralized. 

• Commonality. Distributed Identical computer modules 

(two or more) offer some cost saving and efficiency 
enhancement, e.g., in spares, accessories, software 
support, etc. 


A potential weakness of distributed processing is reduction in total 
operating speeds. This can be avoided by proper modularization along 
functional lines to Insure that the amount of data being transferred 
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between processors is minimized* Advantage can also be taken of recent 
hardware developments* For example, display generation hardware has 

evolved to include the use of "smart terminals" terminals with their 

own local high-speed update computation hardware and memory* In addition, 
computer cpu, memory, and interface speeds have increased in general and 
core-sharing technology is available if necessary, e*g*, the Nova 312 and 
Varian 73 in Table 18* (The VITAL system. Ref* 91, uses this feature of 
the Varian 73 and 76*) Such developments, coupled with an enhanced appre- 
ciation for the necessary computational speeds of the dynamic elements and 
modes involved, make modularizing the computational requirements a viable 
alternative to a centralized host system* 

Another major consideration in selecting computers for use in any 
environment is the available software* Typically, research facilities 
consume extensive engineering manhours throughout their life to develop 
and change the original system’s performance* Software costs soon surpass 
hardware costs* Therefore software should be selected which is of as high 
a level as possible yet flexible enough to include assembly language 
modules for high-speed data handling* A popular method of dealing with 
this requirement is for the machine to enable assembly of MACRO subrou- 
tines as part of a FORTRAN program* An alternative approach is to use 
high-level languages which, when compiled, result in assembly language 
codes which can then be assembled and linked* Some of these languages, 
e*g*, PASCAL, have demonstrated a two- or three-times faster speed than 
FORTRAN* 

In addition, a real-time operating system for efficient program and 
file handling and multiprogramming for simultaneous program development is 
desirable* As also shown in Table 17, most manufacturers provide this 
type of software, but the utility and the quality of documentation and 
support varies* Only the larger minicomputer manufacturers are willing to 
provide frequent documentation of required "patches" to fix "bugs" as the 
software matures* 

One of the requirements germane to this effort is the compatibility of 
at least one of the computers with the CGI display system(s) discussed in 
Section III* This generally adds to the computational system selection 
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factors the desirability of the options for high-speed access to core and 
parallel processing. Even though recent developments in digital display 
systems are handling high update rate reqvilrements with local micro- 
processors and core, the dynamic requirements of the vehicle being 
represented may require frequent changes in display format. Increasing 
the fidelity of the visual scene will also generally increase the core 
requirements for the host computer. This additional requirement can be 
met by providing a high-speed Interface and the option of high-speed ex- 
pandable memory. Most display system manufacturers develop the Interfaces 
for one or more minicomputers. Thus to eliminate the cost of developing a 
special-purpose Interface, it helps to select a computer with which the 
display Implementation is already compatible (e.g., see DEC PDP-11 family 
in Table 17). 

It also adds to the flexibility of the system to select a computer 
which has optional memory speeds. These will range from non-volatile core 
memory through high density, low power MOS memory to high-speed bipolar 
memory. Another factor is the speed of the memory management system. For 
certain types of computations the "bit-byte-block" memory control approach 
(e.g., see Eclipse S230 in Table 17) substantially decreases average 
access time. 

While tradeoff studies can become involved in the details of various 
host computer-display processor configurations, there are usually higher 
priority factors which are more subjective in nature to be considered. 
These Include such intangibles as: 

• Hardware/software reliability 

• Reputation of the manufacturer for delivery, continued 
product expansion support, and growth/potential of the 
company 

• Usage in applications of similar complexity 

• Compatibility with existing facility components 

(including computers) 

• Experience of the users with other computers of the same 
family 

• Quality/cost of maintenance support. 
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Thus, In addition to evaluating quantitative Infomatlon about 
existing computers such as provided in Table 17, several qualitative fac- 
tors based on the experience of other users in the real-time simulation 
Industry must be considered In selecting computational modules. Consid- 
eration of most of the qualitative factors listed above leads inevitably 
to a recommendation of the DEC PDP-11 family. 

B. DIGITAL INTERFACES 

It Is desirable to use standard Interfaces between all equipment in 
the facility. The four most promising candidates are: 

• EAI Standard RS-232C (Ref. 92) 

• ANSI/IEEE-STD 488-1975 (Ref. 93) 

• ARINC 429-3 (Ref. 94) 

• MIL-STD-1553A (Ref. 95) 

From the standpoint of simplicity It appears preferable to use the serial 
RS-232C Interface for all lower-speed (less than, say, 9600 baud) require- 
ments and the parallel lEEE-STD 488 for higher-speed requirements. These 
two, in particular the RS-232C, are becoming more generally supported by 
manufacturers of computers and peripheral equipment and were considered 
preferable. The more complex ARINC 429-3 and MIL-STD-1553A can accom- 
modate commercial and military operational avionics equipment, 
respectively, and are not necessary for the HVSRF as we envision It. 

C. HYBRID STSTEHS 

The foregoing discussion and considerations are directed at digital 
computer hardware/ software aspects which will lead to a preferred system 
structure and requirements specifications In the course of this effort. 
Alternatives to pure digital systems should also be considered depending 
on the nature of the test and evaluation research requirements which 
evolve for the facility. For example, requirements for accurate 
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reproduction of aeroelastic motions could lead to consideration of hybrid 
computations involving both analog and digital modules. 

The tradeoff issues involved in hybrid (versus pure digital) implemen- 
tation are an "apparent" loss of flexibility on the one hand and 
"continuous" update intervals on the other hand. Additional factors for 
comparison Include extra D/A and A/D conversion hardware, relatively 
higher analog unreliability and maintenance, dynamic range limitations, 
and the mixture of skills required to operate the hybrid facility. Most 
of these Issues are usually disadvantageous relative to pure digital. 
However an overriding favorable aspect of analog operations is computa- 
tional speed which can be used effectively to reduce digital computer 
capacity and cycle time requirements, e.g., in Ref. 89. If these should 
become critical, and they may be for large interacting problems , consid- 
eration of the hybrid approach is indicated. 

Thus the Impetus for a hybrid versus a pure digital system would stem 
basically from a research requirement for high fidelity, high frequency 
aeroelastic system dynamics and/or complex pllot/alrframe/envlronmental 
interactions which could absorb excessive digital computer high-speed 
capacity. Depending on the priorities assigned to the computation 
requirements, hybrid candidates may be reconsidered in a future review of 
possible computers, if unforeseen cycle time limitations should develop. 
Such a review should consider existing general-purpose machines (e.g., the 
EAI series) as well as special-purpose designs. However, in view of the 
recommendations in Section III for computer-generated information (CGI) 
displays, hybrid computation is not recommended, because of the Inherent 
reliance of CGI displays on digital computers. 


* A recent fixed-wing moving-base piloted simulation for which STI 
provided technical and programming support involved modeling a rigid- 
body six-degree-of-freedom airplane. The simulation Included encounters 
with arbitrarily located and parametrically characterized wake vortices, 
and strip theory computations of the vortex-induced forces and moments 
as a function of the resulting motions of the pilot-controlled 
aircraft. The initial cycle time of about 0.08 sec resulted in 
unrealistic pilot/aircraft response. To reduce cycle time to a barely 
acceptable 0.06 sec required fairly drastic truncation of the strip 
theory calculations to stay within computer capacity. 
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SECTION VII 


SOFTWARE 


This section describes the computer software recommended for the Man- 
Vehicle Systems Research Facility (MVSRF). 


KEY CONSIDERATIONS 


1. The objective of the facility Is to Investigate man- 
machine relationships which enhance flight safety by 
reduction of human error, not to simulate the mathemati- 
cal physics of particular flight vehicles and systems In 
the complete details usually employed for handling qual- 
ity Investigations. The software development should 
therefore be constrained to satisfy this objective. 

2. Computer hardware and software should closely parallel 
that In the ManrVehlcle Systems Branch of Life Sciences 
Division at Ames Research Center. Having an In-house 
consultant staff will prove Invaluable, and jw compro- 
mise of MVSRF objectives will result. 

3. All possible software should be In a higher-level lan- 
guage. The only requirement for lower-level language Is 
for Input/output (I/O) handlers. 

The MVSRF will require three levels of software, l.e., 

• The Computer Operating System 

• The Experimenter's Executive 

• The Real-Time Running Modules. 


These are shown schematically In Fig. 12 and are discussed further below. 


A. THE COMPUTER OPERATING SYSTEM 


The operating system. Including higher-level language translators, 
assemblers, editors, etc., will (with the exception of certain I/O hand- 
lers) be purchased software. The primary computers will likely be from 
the Digital Equipment Corporation (DEC) VAX-11 or PDP-11 family. Before 
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any computer is selected, as noted In Section VI, a benchmark simulation 
program should be written and executed on each of the prospective candi- 
dates. Besides VAX/VMS, the two most pertinent DEC operating systems are 
the single-user RT-11 and the multiuser RSX-llM. Both of the latter have 
been used for real-time simulation at NASA Ames Research Center. The 
major portion of software should be written In a higher-level language. 
dec’s RT-ll/fORTRAN IV has deficiencies and In real-time operation Is 
significantly slower than DEC's FORTRAN IV-PLUS which Is available under 
RSX-llM but not RT-11. RSX-llM offers the multiuser capability which Is 
essential for software development. The possibility of using the PASCAL 
language under RT-11 may, however, be preferable for real-time simulation. 

B. THE EXPERIMENTER'S EXECUTIVE 


The development of a comprehensive Experimenter's Executive will be 
the key to providing a user-oriented programmable facility. The Executive 
will be a collection of utility packages which will aid the experimenter 
In the design, development, and checkout of his problem and In the reduc- 
tion of data obtained from the facility. 


Problem Setup This module will allow the user to select 

the appropriate real-time modules for his particular 
problem. It Is expected that eventually there will be 
several versions available of real-time module types, 
e.g., flxed-wlng and STOL vehicles. The Executive Setup 
mode will allow the user a simple means of activating 
the desired versions. The Setup mode will also allow 
the user to designate disk files which contain module 
parameter values, e.g., particular aircraft characteris- 
tics. Control of data acquisition and console on-line 
monitoring displays will be exercised via the Execu- 
tive's Setup mode. 

Initialize /Trim This module will allow the user to con- 

trol run-to-run conditions and parameter variations. It 
will exercise each of the selected real-time modules to 
set appropriate Initial conditions and trim the vehicle 
dynamics to the selected starting flight condition. 

Real-Time Running Controller — This module will control the 
timing sequence of the real-time modules. In addition 
to running the problem In actual, wall-clock, real time 
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It will have modes vhlch will allow the experimenter to 
run# the problem In **slow** time or In a single step-by- 
step fashion with the capability to stop the problem at 
any time, l.e., put the system In **hold.” These latter 
modes are Intended to aid the user In system checkout. 

Test/Debug This module will provide an automatic overall 

system test. It would be expected that the automatic 
test would be run prior to and after the completion of a 
set of runs, e.g., twice a day during the production 
running of a given problem. The Debug mode would be 
used In conjunction with the checkout modes of the Run- 
ning Controller. It would allow the experimenter to 
display the value of any variable In any real-time mod- 
ule at the experimenter's console. 

Data Reduction This module will be the user's Interface 

between the real-time data acquisition module and end- 
of-run or batch reduction programs. The module will 
have the capability to collect data both on an Indi- 
vidual run basis and for a selected group of runs. 

Data Playback — The data playback module will provide three 
operating capabilities, viz., (a) the full duplex data 
monitoring capability In real-time to the experimenter's 
console, (b) the accessing and output of partially pro- 
cessed or unprocessed end-of-run data which has been 
stored temporarily, and (c) the retrieval upon command 
at a later time from archival magnetic tape storage of 
data Intended for further Inspection or off-line proces- 
sing on the facilities of Ames Research Center's 
Computation Division. 


An additional Executive module, or perhaps a separate stand-alone 
program, not shown In Fig. 12, voxild be a utility package which would aid 
the user In setting up desired display formats. Although the recommended 
graphics generators In Table 11 (Section III) are driven by FORTRAN- 
callable subroutines, a higher-level Interface between the user and the 
display would be desirable. The Input to the graphics program would be a 
description of each symbol or element to appear on a given display with 
Identification of Its controlling variables. The program output would be 
a FORTRAN module which combines graphics generator calls with other 
required FORTRAN statements necessary to effect the desired display. 
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C. THE REAL-TIME RDHHIN6 MODULES 


1. Background 

The real-time running modules of software for the current and advanced 
technology aircraft simulation host computers (defined In Fig. 1, 
Section I) will perform experimental control over the scenario. Here- 
inafter we shall simply refer to each of these computers as the "host" 
computer. The visual field and display graphics computers (Figs. 2 and 4 
In Section I) and the data acquisition computer (within the experimenter's 
console. Figs. 2 and 4 In Section I) represent "satellite" computers with 
respect to the host computer. Except for flight Instrumentation, the 
primary display driving modules will be embodied in the visual field and 
graphics computers. Alternatively, the flight Instrumentation could be 
provided by general purpose display graphics at a greater cost than by 
using the actual servo- and synchro-driven Instruments as recommended 
subsequently In Section VIII. 

The experimenter's console monitor module allows the experimenter to 
examine and change various program parameters by means of his keyboard 
terminal or the switches on his console discussed In Section IX. 

The data acquisition module embodied In the data acquisition computer 
will collect data not only from real-time running modules but also from 
the external measurement devices discussed In Section IX. 

A recommended software organization will be described and specific 
requirements for various routines will be presented. Particular attention 
will be given to recommend modularity which will provide functional Inter- 
changeability among problems as the facility evolves. The user Input to 
define . each function will be recommended at the highest language level 
possible. This will allow simplicity In use without sacrificing flexi- 
bility by providing Interchangeable modular versions of functions In 
Fig. 12 which require the fewest parametric descriptors. 

Many of the following Ideas are based on years of experience as ex- 
perimenters on the sophisticated simulation facilities at the NASA Ames 
Research Center, particularly the Flight Simulator for Advanced Aircraft 
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(FSAA). Software features of that facility which we have found especially 
useful are incorporated herein. A comprehensive description of the soft- 
ware and hardware for the FSAA is given in Ref. 88. 

The fundamental concept is to provide three basic computer modes 
similar to those of an analog computer: IC (Initial Condition), Hold, and 
Operate. Key features of each mode are as follows: 


IC Computer cycles through equations of motion but not in 

real time. Each cycle starts with an initialization 
routine to set initial conditions and for one time cal- 
culations. No integrations are performed. 

Hold — Similar to IC but without Initialization routine. 

Operate Computer cycles through equations of motion in 

real time. Integrations are performed. 


Since the Operate mode is the only real-time mode and is therefore the 
most critical one with regard to the software organization, it will be 
discussed first and in more detail than the IC and Hold modes. The IC and 
Hold modes will be discussed subsequently. 


2. Operate Mode 

In the Operate mode the computer will be doing a repetitive numerical 
Integration of the equations of motion and aircraft system operations as 
well as various I/O operations. A multiple loop organization is strongly 
recommended for this mode since a single loop operation where all routines 
cycle at the same rate has too many disadvantages. The principal dis- 
advantages of a single loop are: 


• A lack of flexibility in scheduling various computa- 
tional and I/O functions 

• A great reduction in the update rate on important 
vehicle states needed for the visual field and flight 
control system 
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The remainder of this section will assume that a two**loop structure Is 
used. This Is considered the minimum, and expansion to more loops Is 
straightforward. 

The equations of motion are separated Into two parts, called LOOPl and 
L00P2, with LOOPl having the shorter cycle time. A recommended partition- 
ing of ftmctlons between LOOPl and L00P2 Is outlined below: 

LOOPl 

• Higher-frequency control system functions 

• Calculation of aerodynamic forces and moments 

• Evaluation of winds and turbulence 

• Integration of angular equations to get vehicle 
attitudes 

• Integration of linear accelerations to get Inertial 
velocities 

• Computation of angles of attack and sideslip. 

L00P2 

• Calculation of atmospheric properties and Indicated 
airspeed 

• Integration of linear velocities to get position 

• Lower-frequency control system functions 

o Calculation of propulsive system forces and moments 

• Lower-frequency aerodynamic functions, e.g. , update 
functional dependencies on Mach number and flap 
position 

• Low-frequency facsimile aircraft system operations. 
Including navigation, and guidance functions neces- 
sary for scenario generation. 

While LOOPl and L00P2 provide for solving the equations of motion and 
aircraft system operations, several I/O functions must also be provided. 
The I/O functions are divided Into five parts as described In Table 18. 
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TABLE 18 


INPUT/OUTPUT (I/O) FUNCTIONS 


Routine 

Description 

Typical Signals 

ADC 

Analog-to-dlgltal conversion of 
signals from cockpit and 
experimenter* 8 console 

Longitudinal and lateral stick 
Rudder pedal 
Throttle lever 
Flap handle 

DAC 

Dlgltal-to-analog conversion of 
signals to cockpit and 
experimenter’s console 

Cockpit Instruments 
Strip chart recorders 
Control loading signals 
X-Y plotters 

DIO 

Discrete I/O to and from cockpit 
and experimenter’s console 

Mode controls 
Mode Indications 
System controls 
System status Indications 
Trim controls 

Event markers on strip chart recorders 
On/off control of strip chart recorders 
Stores controls 

Switches on experimenter’s console to 
control discrete events 

DD 

Digital data to display graphics 
host computer 

Aircraft attitude 
Uaypolnt hearing and range 
Head-up display parameters 

DA 

Digital data to data acquisition 
computer 

Time 

Cockpit control deflections 
Performance metrics 




These routines provide the communications between the host computer and 
the flight deck, experimenter's console, and other satellite computers. 
During IC and Hold modes communications will also be provided with the 
experimenter's console terminal. This will be discussed later. 

Having considered the various functions to be performed in the Operate 
mode we turn next to discuss the schedule of these functions, l.e., to 
define the sequence In which they are to be accomplished. The software 
will provide great flexibility In the scheduling as the requlrments can 
change dramatically from one problem to another. Two hypothetical exam- 
ples of Operate mode schedules are shown In Fig. 13. They illustrate how 
the relative computation rates for the various routines might be changed 
to meet different problem requirements. 

3. Real-Time Scheduling 

Software to provide the real-time scheduling of the Operate mode rou- 
tines can be quite complex, especially If the desired degree of flexi- 
bility is provided. Fortunately this capability is already provided in 
many real-time multiprogramming operating systems, such as the DEC RSX-11 
series. We will assume that such an operating system Is available to 
handle the scheduling. The remaining problem then is to organize the 

software to utilize this capability properly. 

To retain the advantages of the RT-11 operating system's real time 
features, the following options are required with the RSX-llM operating 
system. 


1. The acquisition of ^ real time clock, either In place of 
the standard clock or as a peripheral device. (The 
software for using the clock Is available from DEC.) 

2. The use of the DEC-supplled, specialized I/O drivers in 
place of the standard I/O. 


* The standard clock has a minimum time increment of only 1/60 sec. 
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It should be noted that RT-11 was written for earlier and less powerful 
computers of the PDP-11 family^ and that RSX-llM was written especially 
for the PDP-11/70. Thus RSX-llM provides the functions that were pre- 
viously performed by RT-11 plus those that allow maximal use to be made of 
this much more powerful machine. 

In using an operating system such as RSX-llM, the applications soft- 
ware Is divided Into tasks. Each task Is a program which can run more or 
less Independently but which can share or transfer data with other 
tasks. One task can activate or deactivate another task and establish a 
schedule or repetition rate for It. The repetition rates and priorities 
of various tasks determines the sequence In which they are executed. 

The MAIN task would be In overall control. It would handle mode 
switching, setting up the Operate mode schedule through the operating 
system, and other functions discussed In the next subsection. The other 
tasks would be activated only In the Operate mode. They would be acti- 
vated by the MAIN task which would also establish their repetition rates 
through a command to the operating system. 

The other tasks would collectively represent all the Operate mode 
routines discussed earlier. In fact, by creating a separate task for each 
of the seven routines, (LOOPl, L00P2, ADC, DAC, DIO, DID, DA) we can main- 
tain a great deal of scheduling flexibility. 

The only problem now Is that most of the Operate mode calculations 
also must be performed In the IC and Hold modes. This can be overcome by 
simply having each of the tasks, other than MAIN, be merely a CALL to a 
corresponding subroutine, l.e., task LOOPl only calls subroutine SLOOPl. 
This keeps all the computations In subroutines which can be called 
directly from MAIN when In IC or Hold mode. In these modes there Is no 
real-time constraint, so MAIN can simply cycle through the subroutine 
calls repeatedly. 

Using the same subroutines In all three modes avoids unnecessary dup- 
lication of software. However there are some computational differences 
among the modes. An obvious one Is that Integrations are performed only 
In the Operate mode. A less obvious one Is the need to provide some 
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responses to the cockpit controls even in IC« After completing an 
experimental run, and the experimenter has returned to IC, the pilot may 
need to reset some controls for the next run, e.g., throttle and flaps. 
To avoid a large transient when going to Operate, at least the steady 
state responses to these controls must be generated. The engine thrust 
must go to the right value and the engine Instruments must respond accor- 
dingly. The flaps must go to the desired angle and this must be reflected 
In the flap angle Indicator. 

Clearly each subroutine must contain whatever logic Is required for 
each computer mode. Careful attention to this requirement must be exer- 
cised during the software development. 

4. MAIN Task Description 

The primary functions of this task are mode control and scheduling. 
Requests for mode changes would be initiated by switches or discrete key- 
board commands In the cockpit and at the experimenter's console. These 
switches would be read during Che discrete I/O. 

The Operate mode has already been discussed. In IC, the MAIN task 
would cyclically call the following subroutines: 

SETUP 

SADC 

SLOOP 1 

SLOOP 2 

SDAC 

SDD 

SDIO 

The only new subroutine Is SETUP. . It performs certain initialization 
functions and one-time calculations. More details on SETUP are given 
subsequently In Subsection 6. 

For the Hold mode, the same subroutine sequence can be used except for 
SETUP, which Is not called. 
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The MAIN task has several Important functions In addition to mode 
control and scheduling. These are discussed In the remainder of this 

subsection. 

Normally the termination of an experimental run will be accomplished 
by switching from Operate back to IC at the experimenter's console. Be- 
fore resuming the normal IC calculations, MAIN should take care of any 
end-of-run requirements. These might Include special post-run 

calculations, data output, closing data files, strip chart calibration 
signals, and strip chart run numbers*. 

Another function Is error handling. These might be computational 
errors, e.g. , overflow or sqiiare root of a negative number. Another type 
of error is the failure in Operate to complete calculations within the 
specified time Interval. 

The remaining ftinctlons to be described here all provide service in 
response to requests from the experimenter. In IC or Hold the computer 
will be cycling through a series of subroutines. This sequence can be 
interrupted by an experimenter's request from his keyboard terminal or the 
switches on his console. When the request has been serviced, the computer 
would return to the cyclic sequence. 

One of the most Important service functions is to allow the experi- 
menter to examine and change various program parameters. This capability 
is vital during program debugging and very useful in controlling experi- 
mental variables. Among the parameters which should be accessible are: 

e Initial conditions 

• Wind and turbulence characteristics 

• Ship or target characteristics 

• Scheduling parameters 


* Special signals can be used to ’’write" run numbers on the strip chart 
recorders. 
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• Data recording par^eters 

* Strip chart assignments^ scale factors, and biases. 

Simple and convenient access to any program variable is desirable but 
not easily accomplished. This is an important subject but too complex to 
discuss at this point. Subsection 5 describes three different approaches 
which might be used to provide this function. 

While the terminal is a suitable medium for altering a few program 
parameters, the experimenter should also have a method for large scale 
changes. This can be accomplished by allowing the experimenter to specify 
a disk file which contains the desired changes. This would permit rapid 
(and error free) changes in the complete test scenario. 

Another important fraction is the ability to trim the aircraft. To 
avoid large transients the aircraft must be trimmed before going to 
Operate. This can be accomplished by having the experimenter completely 
specify the initial conditions. A much more satisfactory approach is for 
the experimenter to specify only some initial conditions and to let the 
computer use the remainder to trim the aircraft. For example the experi- 
menter might specify the aircraft initial position and velocity vectors, 
and the computer could adjust the aircraft attitude, thrust, and elevator 
deflection to trim it. 

The trim routine is an iterative procedure. It varies selected param- 
eters until equillbrlxim is established. It is desirable to have an 
algorithm that converges rapidly and is very general with regard to what 
combinations of initial conditions the experimenter specifies. For 
example, the experimenter may specify airspeed and rate of climb, or he 
could specify airspeed and throttle setting. 

Such a general algorithm is very difficult to realize; therefore, 
careful consideration should be given to the required capabilities for the 
trim routine. It should be able to handle all reasonably likely situa- 
tions but should not be overly general. It is better to have a few 
options that work reliably than a great many options which sometimes will 
not converge. 
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The trim routine also Imposes requirements on subroutines SLOOPl and 
SL00P2. These subroutines will be used to determine the aircraft accel- 
erations at each step of the trim Iteration. Special logic Is needed for 
trim Just as It was for the various modes (1C, Hold, Operate). Integra- 
tions are not to be performed and provisions to bypass some control 
dynamics must be made. For example, one would have to bypass the engine 
and actuator dynamics to find the trim throttle and elevator settings. 

The last MAIN task function we will discuss Is to provide dynamic 
checks. This Is strictly a debugging tool and Is used principally to 
check the programmed aircraft and system dynamics. This routine would 
allow the experimenter to apply a prescribed Input through one of the 
aircraft controls and observe (e.g. , on the strip charts) the aircraft 
responses. The available Inputs should Include at least the primary cock- 
pit controls: longitudinal and lateral stick, rudder, and throttle. 
Allowable wave forms should Include step, pulse, doublet, and sine wave of 
specified magnitude and duration. 

5. Accessing Program Parameters 

As Indicated In the previous subsection, the experimenter should be 
able to examine and change various program parameters. There are several 
methods of providing this capability, and three options are discussed 
below. They are discussed In the order of Increasing programming effort 
required and Increasing ease of use by the experimenter. 

One method Is to use the Debug routine which Is part of the computer's 
operating system. This has great flexibility In that any program param- 
eter can be accessed. The disadvantage Is that most Debug routines 
require the user to specify the parameter address (memory location) rather 
than the FORTRAN name. This Is clearly awkward for the experimenter and 
Is likely to result In frequent mistakes. One Is more apt to make a mis- 
take In typing a number than a FORTRAN name. Furthermore a simple 
numerical error will probably still result In a valid address. An error 
In typing a FORTRAN name will probably produce an Invalid name, and the 
computer can alert the user to that fact. 
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The second option is to write a FORTRAN (or assembly language) routine 
i^lch provides access to selected program parameters. It would be quite 
simple to program if parameters were identified by a code number (use an 
EQUIVALENCE statement to select FORTRAN variables with an array). The 
program is only slightly more complex if the parameters are identified by 
their FORTRAN names or other mnemonics. 

One disadvantage of this approach is that the routine will be specific 
to a particular program. Substantial changes may have to be made for each 
new program. 

Another disadvantage is that the experimenter can access only selected 
parameters. It is very difficult to anticipate all the parameters one may 
wish to access. This is particularly true when debugging a program but 
also applies during the actual experimental tests. 

The last option, and the best one from the experimenter's viewpoint, 
is to develop a routine comparable to CASPRE (Ref. 88). With the CASPRE 
routine one can access any parameter by its address or FORTRAN name. The 
CASPRE software uses the storage map generated by the compiler and the 
load map to determine the memory location of a specified FORTRAN name. 
This approach provides great flexibility and ease of use, but would re- 
quire substantial software development. This option might be included in 
one of the later development phases of the facility. 

6. Subroutine SETUP 

This subroutine performs initialization functions and one-time calcu- 
lations. Variables used as inputs to the real-time subroutines must be 
properly initialized, such as; 

• Aircraft Euler angles 

• Body axis angular rates 

• Inertial velocity components 

• Aircraft position. 
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There may be some initial condition options, e.g., specifying the 
initial speed in terms of Mach number, true airspeed, or equivalent air- 
speed. Logic to handle each of the options must be provided. 

An example of a one-time calculation would be to compute the moments 
of inertia given an initial weight or configuration. This assumes that 
these would not be varied during the course of an experimental run. 

7. Subroutine SLOOPl 


This subroutine encompasses all the calculations which are to be done 
in the faster Operate loop. Many of these calculations, such as the kine- 
matics, will be the same for all experiments. Others will be specific to 
a particular aircraft or experimental project. By partitioning SLOOPl 
into several subroutines we can Isolate the general and specific calcula- 
tions, and also provide a functional breakdown. 

The remainder of this subsection Illustrates one method of parti- 
tioning. Several subroutines are described. Each is identified as a 
general subroutine or one that would be specific to a particular experi- 
ment. The functions and required outputs of each are indicated. 


CONTRl Specific subroutine. Used for implementing the 

higher frequency components of the control system, such 
as stability augmentation and surface actuator 
dynamics. Outputs are control surface deflections. 

AEROl Specific subroutine. Inputs are control surface 

deflections and aircraft state (e.g., airspeed, Mach 
number, dynamic pressure, angles of attack). Outputs 
are total aerodynamic forces and moments. 

WIND General subroutine. Models a deterministic wind as 

a function of position or time. Also models random 
turbulence with option for repeated or new turbulence on 
different runs. Outputs are the total velocity of the 
air mass and equivalent angular rates for gust gradient 
effects. 

ROTATE General subroutine. Integrates the rotational 

equations of motion and updates the Euler angles and 
body axis rates. Outputs are Euler angles, angular 
velocity, and body/ earth transformation matrix. 
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LINEAR General subroutine. Integrates the linear equa- 

tions of motion and updates inertial velocity# Outputs 
are inertial velocity components# 

AIRSPD General subroutine# Computes aircraft velocity 

relative to air mass. Outputs are airspeed , angle of 
attack, and angle of sideslip# 

DATA — Specific subroutine. Used for real-time data col- 
lection and processing# Will supply data from real-time 
running modules to satellite data acquisition computer# 

INSTRl General subroutine# Used to compute drive signals 

for some cockpit instruments, e#g#, to compensate for 
instrument non-linearities# Outputs are drive signals 
for instruments# 

DISPLAY Specific subroutine# Computes any special quan- 

tities required for the visual field and display 
graphics computers# 


8« Subroutine SL00P2 

This subroutine encompasses all the calculations vhich are to be done 
in the slower Operate loop# These should also be partitioned into various 
subroutines# One method of partitioning is illustrated below. 


ATMOSPH General subroutine# Computes atmospheric proper- 

ties as function of altitude and other aerod 3 mamic 
quantities# Outputs are atmospheric density, pressure, 
dynamic pressure, Mach number, equivalent airspeed, and 
calibrated airspeed# 

POSIT — - General, subroutine# Integrates linear velocity to 
get aircraft position# 

C0NTR2 Specific subroutine# Used for Implementing the 

lower frequency components of the control system, e#g#, 
flaps, trim system, and guidance loops# 

ENGINE Specific subroutine# Models the propulsion 

system# Outputs are total propulsive forces and 
moments, and variables needed to drive cockpit engine 
instruments# 


TR-1 156-3 


122 



AER02 — Specific subroutine. Used for implementing the 
lower frequency components of the aerodynamic model, 
e.g., updating coefficients or tables used in AEROl 
which are functions of flap or Mach number. 

INSTR2 General subroutine. Used to Implement a variety 

of lower frequency functions for the cockpit Instruments 
and other output devices. Provides compensation to 
drive non-linear Instruments. Turns strip chart recor- 
ders on and off and controls paper speed. Provides 
special signals for strip chart recorders, such as: 
variable sensitivity as a function of range or altitude; 
variable bias, e.g., "cyclic" display which jumps to 
opposite edge when pen reaches one edge limit; multi- 
plexing of two variables on one recorder channel. 

SCENE Specific subroutine. Used in conjunction with 

POSIT, DISPLAY, and C0NTR2 for implementing the low 
frequency facsimile outputs from aircraft system opera- 
tions, Including navigation and guidance functions 
necessary for scenario generation. Provides relative 
positions of runway, navald, waypoint for DISPLAY, and 
calculates guidance commands for C0NTR2. 


This concludes a preview of the computer software required for the 
facility. In the next section we shall outline some of the requirements 
for the flight crew stations. 
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SECTION VIII 


FLICTT CREW STATIONS 


The flight decks for the MVSRF will provide operating facsimiles of 
control-display crew stations for pilot, copilot, and flight engineer who 
will participate in the evaluations of the causes of human error. In 
addition a seat and space for an observer will be provided on each flight 
deck aft of the pilot with a clear view of the three operating crew 
members. Four adjustable flight-qualified seats will be provided on each 
flight deck. Whereas it is important that the crew station layout help to 
Induce the correct forms of the crew member's cognitive and psychomotor 
behavior, it is not necessary that each crew station be an exact replica 
of that in a specific aircraft. Nevertheless, as we stated at the outset 
in Section I, the identical elements theory of Thorndike will likely be 
Invoked for the current technology flight deck. Thus it would seem to be 
cost-effective to provide the current technology flight deck by adapting 
the same from a training simulator for the chosen aircraft as recommended 
in Ref. 5. This is because of the Importance (for studying the causes of 
human error) which is vested in the capability for initiating, monitoring, 
and controlling various flight and ATC system malfunctions and failures in 
the MVSRF. Reverse transfer of training (from flight experience to the 
MVSRF) is thus very Important among flight crew members who will partici- 
pate in full mission simulations. Reverse transfer is believed to be 
assured by providing a current technology flight deck which is 
functionally identical to that in a contemporary jet transport With which 
a significant portion of the airline pilot population has experience. 

Likewise, because of the Importance attached to studying the causes of 
human error, access to ‘’initial condition,” "hold,” or "reset” control 
over the simulation should not be provided within Che flight deck, thereby 
denying to the crew one means for concealing human error in the simulator. 

Both crew station designs should, however, provide for relatively 
convenient access to the display and control installations for modifica- 
tion and maintenance and should be open and spacious enough so that 
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portable measuring equipment can be easily Installed without Interference 
In each operator’s activities. Each flight deck Itself will be mounted on 
a fixed base with provision for subsequent addition of a motion base. 
Convenient access for Ingress and egress Is also recommended, yet each 
crew station should provide an opaque enclosure for excluding ambient 
Illumination while admitting a flow of conditioned air for crew member 
comfort. 

Some requirements for the crew stations In the advanced technology 
flight deck are summarized next. The functional layout of the pilot’s and 
copilot’s controls and displays will be as consistent as possible with the 
corresponding two-abreast crew stations In transport aircraft expected to 
be operational In the time period of Interest. The flight engineer’s 
station In the advanced technology cockpit will be aft of the central 
console between pilot and copilot, but facing the central console. The 
observer will be aft of the pilot. The flight deck will consist of a 
structural frame and shell, removable opaque windows and windscreen with 
provisions for pilot’s and copilot’s collimated external visual displays, 
aft door for Ingress/egress, adjustable flight qualified seats, pilot’s 
and copilot’s two^axls pedestal controllers with trim controls and 
variable loading, pilot’s and copilot’s adjustable rudder pedals, common 
throttle controls on the central console, direct lift or thrust vector 
controls, also on the central console, programmable tlme^shared control 
display units for aircraft systems, lighting and air conditioning and 
their respective controls, fuel and energy management controls, automatic 
flight controls, CNI* controls, data cases, audio Intercommunication set 
and Its controls, necessary cabling to Interconnect with the facility 
Input/output subsystem, provision for crew performance monitoring equip- 
ment, and audio environmental special effects. We shall now discuss and 
recommend the following items required for the advanced technology crew 
stations, viz.. 


* Communication, Navigation, and Identification. 


TR-1 156-3 


126 



• External visual field and head-up displays 

• Primary head-down displays (e.g. , VSD, HSD, MPD, SAD) 

• Display graphics generator 

• Controls and control loading 

• Flight Instruments 

• Programmable multifunction keyboard. 

A. EXTERNAL VISUAL FIELD AND HEAD-UP DISPLAYS 

The requirements and equlpmental candidates, Including the cathode ray 
tubes, for presenting the collimated visual-field and head-up display are 
presented and discussed In the foregoing Section III. 

On the flight deck each display will consist of two cathode ray tubes 
with their optical collimators, one mounted In place of the pilot’s wind- 
screen, the other In place of the copilot’s windscreen. Each display will 
Initially provide a 45-deg-azlmuth by 35-deg-elevatlon field of view and 
properly scaled virtual Image approaching optical Infinity. Future visual 
traffic detection and STOL Investigations may require additional field of 
view, e.g., side window views for curved approaches. For this reason the 
external visual display must be modular so that It can be expanded to 
provide more field of view (Ref. 3), 

B. PRIMARY HEAD-DOWN DISPLAYS 

The control-display configuration of the advanced technology crew 
station will Include at least the following primary head-down display 
functions and equipment on the instrument panel in the pilot’s, copilot’s, 
and flight engineer’s forward fields of view. 

1. Vertical Situation Display (VSD) 

The VSD will be capable of displaying computer-generated alphanumeric, 
calligraphic, and raster-graphic data having the format of an electronic 
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attitude director Indicator* The VSD will also be capable of presenting a 
simulated processed forward-looking sensor (such as radar, TV, IR) infor- 
mation consistent with the pilot's view of the external world in azimuth 
and elevation* Flight command, navigation, and discrete information may 
be superimposed on the VSD. Adjustable brightness and contrast controls 
for the VSD should be located conveniently on the display. Two VSDs are 
required, one in front of the pilot, the other in front of the copilot. 

2. Horizontal Situation Display (HSD) 

The HSD will be capable of displaying computer-generated alphanumeric, 
calligraphic, and raster-graphic data having the format of an electronic 
moving map. The HSD will also be capable of presenting a simulated pro- 
cessed sensor (such as radar, TV, IR) Information consistent with the 
pilot's "plan view" of the external world with respect to the nadir. 
Computer-generated navigational and traffic information nay be 
superimposed on the HSD, and the HSD will serve as a backup display for 
the VSD. Adjustable brightness and contrast controls for the HSD should 
be located conveniently on the display. Two HSDs are required, one below 
the VSD in front of the pilot, the other likewise in front of the copilot. 

3. Hultipurpose Display (HFD) 

The MPD will be capable of displaying computer-generated alphanumeric, 
calligraphic, and raster graphic data having formats appropriate for air- 
craft propulsion, data link communications, and other on-board systems 
monitors. The MPD will be used for systems operation and fault diagnosis 
by the flight engineer as well as the other crew members. Adjustable 
brightness and contrast controls for the MPD should be located conven- 
iently on the display as well as on the flight engineer's console. Two 
MPDs are required right and left of the center of the instrument panel. 
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4. Status Advisory Display (SAD) 


The SAD will be capable of displaying conputer-generated alphanumeric, 
calligraphic, and raster-graphic data having the formats of engine status, 
warning, caution, subsystem mode, and auxiliary subsystem management dis- 
plays. One SAD should be centrally located for viewing by all crew 

members and should have adjustable brightness and contrast controls 
located conveniently on the display as well as on the flight engineer's 
console. At least two other SADs should be located outboard of the 
pilot's and copilot's VSDs. 

5. Flight Instruments 

Provision should be made for the Inclusion of conventional back-up 
Instruments such as artificial horizon or ADI, turn-and-bank, airspeed, 
ground speed, course, heading or HSI, Instantaneous vertical speed, 
barometric and radio altitude Instruments, and a clock with controllable 
elapsed time Indication function on the pilot's Instrument panel. 

C. DISPLAY GRAPHICS GENERATOR 

The display graphics generator is used In conjunction with the "host" 
digital computer to generate a variety of display formats for projection 
on the CRT displays of the advanced technology flight deck and experimen- 
ter's console. The CRT display formats will be representative of those 
formats generated In the display programs of advanced systems such as the 
terminal configured vehicle (e.g. , EADI, EHSI, FMS, CDTI, ACARS, ATIS, 
DABS, and BCAS in Ref. 96). 

A number of commercial graphics generator systems are available 
today. Three techniques for writing the CRT picture are in use. These 
techniques employ random-vector or stroke writing (calligraphy), the 
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raster, and the storage tube* (Ref. 97). However calligraphic and raster 
graphic techniques dominate the commercial market for computer graphics. 
The image on a non-storage CRT needs to be refreshed to hold the Image and 
avoid flickering. Storage tubes can store an image for considerable time 
without refreshing. Random vector systems draw Images as line segments 
from point to point. Raster systems use horizontal and vertical sweeps as 
in a TV, brightening the sweep at desired points to form the image. The 
raster system can mix real-time video and computer-generated video; 
however, raster mixing update rates will not be as great as with the scan 
conversion storage tube. 

Capability of the display graphics generator to generate elec- 
tronically geometric symbols and alphanumerics is essential. Both 
calligraphic and raster systems described in Table 11 (in Section III) 
offer the combined capability to program geometries and alphanumerics; 
however, the raster technique offers a more efficient way than 
calligraphic to generate alphanumerics. 

The choice of display graphics generator technique and equipment se- 
lection will be dictated by data display requirements, computer software 
support by the manufacturer, and cost. A calligraphic chromatic generator 
is recommended initially, primarily because it will provide better resolu- 
tion at reasonable cost for the head-down vertical situation display 
(VSD), which may have elements in common with the HUD. Eventually 
separate calligraphic and raster display graphics generators appear to be 


* Two types of storage tube are used today, the direct view type and the 
scan converter. The latter is the most ideal candidate for the graphics 
application but is not predominantly available commercially for computer 
graphics generation. The scan converter combines techniques of the 
random, raster, and storage types. The image is written in random 
technique on an internal storage tube and the information is then 
transferred to a standard TV (raster) monitor for display. 

Scan conversion offers the potential advantage of lower price over 
refresh systems, it can be selectively erased, and it can mix real-time 
video and computer-generated graphics. Complex visual scenes are still 
subject to update rate limitations with the scan converter, but for most 
of the graphics displays complex visual scenes are not required. 
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necessary since no vendors offer a combination at this time or for the 
foreseeable future, and the horizontal situation displays (BSD), multi- 
purpose displays (MPD), and status advisory displays (SAD) could make more 
efficient use of a raster graphic generator. Although one graphics 
ccanputer may be sufficient initially, two graphics computers are recom- 
mended eventually to avoid update rate limitations (via direct memory 
access) in presenting both calligraphics and raster graphics. Since 
different phosphors are required in the cathode ray tubes for the calli- 
graphic or raster presentations, interchangeable cathode ray tubes may be 
needed in the multipurpose display, for example. 

D. CONTROLS AND CONTROL LOADING 


At the outset it will be sufficient to provide only fixed mechanical 
spring force gradients on each of the advanced technology primary flight 
controls. However a modular programmable control loading system is ulti- 
mately recommended for primary flight controls, even in the advanced 
technology flight deck. 

While it is recognized that the facility is not intended for simula- 
tion studies of control feel characteristics, it is believed that a low 
fidelity representation of these characteristics would prove distracting 
to pilot subjects to the level where it might degrade their responses in 
evaluating and acting on the information portrayed on their displays. 
Therefore it is desirable to invest in a modular control-and-loading in- 
stallation which will provide electro— mechanical adjustable force feel as 
a function of the represented aircraft flight condition. Examples of such 
modular control loading equipment are described in Appendix C, 

E. FLIGHT INSTRUMENTS 


The problem of presenting cockpit flight instruments is most easily 
solved by using actual aircraft instruments driven by DC-to-synchro con- 
verters. The one exception to this would be the altimeter. 
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Synchro-driven cockpit instruments can be adapted for MVSRF with the ^ 

aid of an item of equipment provided, for example, by HcFadden Electronics 
Company, in addition to the necessary accompanying channels of digital-to- 
analog (D/A) signal conversion which are planned for the facility. 

The universal McFadden Model 205A1 Instrument Servo Assembly is a DC- 
to-synchro converter which functions as an interface between analog vol- 
tages and flight-qxialified synchro driven cockpit flight instruments. The 
system is designed on a modular basis five channel modules with inte- 

gral power supply per system - — to enable future expansion with maximum 
ease. It has gained wide acceptance among users of flight simulators. 

Each channel is a complete closed loop servo which accepts DC signals from 
an analog computer or D/A converters and provides synchro transmitter 
output proportional to command voltage. With a 5- or 10-channel system, 
any 5 or 10 synchro driven aircraft instruments can easily be converted to 
DC servo-driven instruments. This system provides smooth motion and fast, 
first order response. 

By adding another synchro to each module provision can be made to 
drive a second instrument (at the experimenter's console) if it be desired J 

to duplicate the pilot *s display. A 26 VAC 400 Hz reference supply is 
also required. Specifications for Model 205A1 DC Instrument Servo 
Assembly are given in Table 20 together with a photograph. 

The McFadden Model 106B DC Servo Altimeter is a high-performance, 
multiturn, closed-loop position servo which drives directly the hands of a 
conventional altimeter with a range from 0 to 100,000 ft and a lighted 
dial. The normal barometric sensor has been removed and the case has been 
elongated to accommodate the servo components. It provides smooth motion 
over a wide dynamic range, low threshold, fast stable response, and low 
resolution and is available in lOV or lOOV scaling. Specifications and a 
photograph are provided in Table 20. 

F. PROGRAMMABLE MULTIFUNCTION KEYBOARD 

Discrete function, mode, and status controls at the crew stations in 
the facility are best provided by a flexible easy-to-use controller which 
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TABLE 19 


SPECIFICATIONS FOR McFADDEN COCKPIT SIMULATOR INSTRUMENTS 



eOCKPlI SIMIIIATOB INSTRIIMENI8W 



• •> .. *. - 

MODEL 206B DC'S! MU LATOR 7VLTI METE 

The Model 206B DC Simulator Altimeter is a hish performance m 
turn, closed loop position scrv(Twhich direct drivM ^e hands of 
conventional co ckpit altimeter. The 'liw ^ baromefrV j»hs^^ 

been removed and the case has been elon^'ted tb'acco^ 
servo components. Standard panel mounting is 
206B features smooth motion over a wide dynamic range, Ibvv'^^ 
hold, fast stable response and low resolution. Available with 10V 
lOOVtcaling. ; . ... : r 

SPECIFICATIONS: 





Resolution:'.; 

Poww:':. DC 


Max Rate: .. Greater thsn 200,000 



MODEL 205A1 DC INSTRUMENT SERVO^; 

The Model 205A1 Imtromeht^Sei^o ^sembly ila complete closed • 
i, Tloop device which accepts D.CI signals from an analog computer w 
other source and provi dM^an but puF & aft "p ositl bn proportional to * 
S^command vblta^^ converteF^e unit is designed 

IC^Oaround 5 channel modules vyith an integral power supply. The system 
'^-1$ designed on a modular basis to cnable'futurc expansion with maxi- 
*'^'mum ease. One application is DC to ‘Synchro interfacing between 
Computer and Cockpit Simulator Instruments. Features include 
smooth motion and fast, first order response. 

SPECIFICATIONS: _ 



R^sb i utid nf ■ Les^ tfia n 0.02% of F.S. v'?*: 

Minimum Smooth Rate: Less than 0.02% of F.S. per sec 

V* Slewing Rate: Greater than 25% of 
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is not aircraft console-specific and which Is compatible with the EAI 
Standard RS-232C digital Interface. An example of such a controller is 
available from Instrumentation Technology Corporation (ITC), Northridge, 
California as Model 9654 Plasma Display Terminal. It looks like (and can 
be used as) a teletype to a computer system, but it can also be used as a 
programmable multifunction keyboard. The man-machine Interface is accom- 
plished by means of a programmable graphic display with built-in operator 
touch control. 

The heart of the system Is a Digital Equipment Corporation LSI-11 
microcomputer, which is software-compatible with the PDP-11 family of 
minicomputers. The availability of extensive LSI-11 software makes the 
Model 9654 well suited to be used also as a stand-alone computing tool. A 
functional description and technical specification are provided in 
Appendix D. 
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SECTION IX 


EXPERIMENTER'S CONSOLE DATA ACQUISITION SYSTEM 

The purposes of each experimenter's station (Fig. 1, Section I) are 
fourfold: 

• Control the overall operation of the facility; hence the 

alternative names: facility operator's console or 

operator's station. 

• Permit the setup, checkout, control, and monitoring of 

the experimental scenario Including alr-trafflc control, 
mission-related tasks and subsidiary workload measure- 
ment tasks discussed In Ref. 2. 

• Allow the setup, checkout, control, and loonltorlng of 

flight crew procedure, measures of system performance, 
and subject behavior. 

• Provide for non-lntruslve on-line and archive data 

acquisition. 

The hardware and software operator Interfaces should be based on sound 
human factors principles. Each experimenter's station should allow for 
convenient and reliable manipulation of the experimental conditions and 
scenario, and give the operator a "bird's eye" view of facility status and 
subject performance. Each experimenter's station should permit either 
Independent or coordinated operation of both current and advanced tech- 

nology simulations with or without simulated air traffic control 
authority. In the next topic we shall consider the current technology 
simulation console In more detail. 

A. CURRENT TECHNOLOGY SIMULATION CONSOLE 

Preliminary functional requirements for the experimenter's console In 
the current technology simulation were outlined In Section I. The experi- 
menter's console functions can be briefly summarized as follows; 
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Flight and crew performance monitoring 
Traffic controller performance monitoring 
Crew comfort monitoring 

Malfunction control over the vehicle and flight system 
models 

Data acquisition control 
Operational control of the simulation 
Communication control 
Environmental control. 

Except for the more comprehensive performance monitoring, data acqui- 
sition, and operational control functions needed in the MVSRF, virtually 
all of the basic functional requirements are provided in the operator's 
console of a current technology aircraft training simulator. Thus, as in 
the case of the current technology flight deck, it is also cost-effective 
to provide the current technology experimenter's console by adapting and 
expanding the instructor's station from a training simulator for the 
chosen aircraft. To the instructor's console should be added the perfor- 
mance monitoring, data acquisition, and operational control functions 
needed for the MVSRF. The performance monitoring and data acquisition 
functions should Include measurements described in Ref. 2 which are 
suitable for: 

Procedure-centered evaluation 
System performance-centered evaluation 
Human operator-centered evaluation. 

The data acquisition media should include 

On-line display 

Soft copy (e.g. , magnetic tape) 

Hard copy (e.g. , strip charts, printed paper) 



To the operational controls should be added an Interactive graphics and 
text display terminal with keyboard and hard copy printer to aid both 
operator and experimenter In effecting necessary modifications to the 
software described in Section VII. 

The suggested layout of the operator’s station and data acquisition 
functions should also take into account current laboratory equipment and 
capabilities available to the Man-Vehicle Systems Branch as well as recom- 
mended future equipment, capabilities, and computer program development. 
The current equipment and capabilities which we recommend to be tied in 
with the operator’s station are as follows: 


• Oculometer and associated equipment . The oculometer 
sensor will be mounted in the instrument panel and the 
associated signal processor and teletype will be located 
at the experimenter’s station. The two eye-polnt-of- 
regard output signals can be connected with the data 
acquisition system via its A/D converters for further 
processing with a currently available program (e.g.. 
Ref. 98). 

• Semi-Portable Physiological System (optional). The 
purpose of this unit is to provide measures of workload- 
induced stress. In order to minimize obtrusiveness in 
the cockpit and to ensure the greatest possible realism, 
physiological measures will be omitted initially 
(Ref. 7). In the event that these measures are added, 
this unit should be mounted adjacent to the experi- 
menters’ station with provision for sending available 
electrical analog signals such as electrocardiograph 
(EKG), electroencephalograph (EEG), electromyograph 
(EMG), respiration rate, and Palmar skin resistance to 
the data acquisition system via its A/D converters, 
discussed hereafter. On-line monitoring can be provided 
by the unit’s own chart recorder. 

• Voice Stress Analysis System . This system can also be 
used to provide a measure of workload-induced stress. 
The audio tape recorder furnished with this device 
shoxild be tied in with the facility communication sys- 
tem, discussed hereafter. Tape recordings would then be 
used for voice analysis offline and the stress evaluator 
would not have to be located within the experimenter’s 
station. 
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It Is further reccxnmended that the experimenter's station capabilities 
be expanded to Include the following functions. 


• Data acquisition computer system and associated periph- 
erals. The block diagram In Fig. 14 Illustrates the 
recommended duplex signal routing for acquiring and 
monitoring experimental data In real time using the data 
acquisition system. For this purpose, the data acquisi- 
tion system should also be connected via a new digital 
Interface with each host computer having executive con- 
trol of the experiment. For the current technology 
flight deck, 16 channels of A/D and 16 channels of D/A 
conversion should be acquired Initially for routing data 
to analog displays on the experimenters' console and to 
strip chart recorders. A CRT/keyboard terminal and line 
printer can also be used for data display and magnetic 
tape units can be used for storage of monitored data. 

With the addition of the advanced technology flight 
deck, we also recommend the addition of 16 channels of 
A/D and 16 channels of D/A conversion Interface for on- 
line monitoring of crew comfort and performance. 

• Communications Controls. An example of a multiple- 
station communications control panel for the experi- 
menter's console Is shown In Fig. 15, based on 
Ref. 99. The controls on this panel enable the facility 
operator and experimenter to communicate by voice with 
all participants in the flight and traffic control simu- 
lation. By use of the push-button switches, symboli- 
cally represented in Fig. 15 by squares (Q), the 
operator may establish several point-to-point links or 
conference networks for either one-way or two-way 
communication as desired. The operator and experimenter 
may monitor the voice link or speak over It. Controls 
for the recording bus and noise sources are also avail- 
able on the panel. 

In the next topic we shall consider the advanced technology simulation 
console In more detail. 


B. ADVANCED TECHNOLOGY SIKDLATION CONSOLE 


The operator's control console for the advanced technology simulation 
should likewise be designed to enable the experimenter to control and 
monitor the progress of the simulation and the comfort status of the crew 
members. A suggested layout of the experimenter's console is shown in 
Fig. 16. The following functions are recommended. 
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Recommended Duplex Signal Routing for Acquiring and Monitoring Experimental Data 
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Figure 15. Example of Facility Operator’s Communications Panel 

(Based on Ref. 99) 














1. Head-Up Display and Visual Field Display Monitor; 

Vertical Situation Display Monitor; and 
Horizontal Situation Display Monitor 

The central region of the experimenter’s console in Fig. 16 is re- 
served for two 21-inch CRT monitors. One of the 21-inch monitors will 
repeat the combined head-up display-and-visual field and the other, a 
split screen arrangement of the VSD and the HSD as seen In the cockpit. 
Each monitor display should be shielded (e.g., by hood or filter) from 
ambient incident illumination and should be provided with independent 
brightness and contrast controls. 

2. Multipurpose Display Monitors and 
Status Advisory Display Monitors 

Monitors are recommended left and right of center in Fig. 16 for 
multipurpose and status advisory displays, all of which are likely to be 
In raster format. 

3. Backup Flight Instruments (Optional) 

Backup flight Instrument repeaters, located at the upper left In 
Fig. 16, are recommended with provision for glare shielding and Indepen- 
dently controlled lighting. 

4. Simulator Status Displays and 
Interactive Controls 

Simulator status displays [e.g., host computer(s), graphic genera- 
tor(s), control loading, data acquisition] and Interactive controls are 
recommended. Real time operating controls for problem setup, operation, 
options, hold, and reset or Initial condition are shown left of center at 
the bottom of the console. Host terminal controls (extreme lower left) 
should be provided for changing, while a problem is in progress. Initial 
conditions, constants, and data acquisition. It should also be possible, 
while a problem is in progress, to delete and restore primary display 
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symbols which are within the programmed repertory for the HUD, VSD, HSD, 
MPD, and/or SAD. Positive means should be provided via graphics display 
for confirming, while a problem is in progress, that all required data are 
being recorded or stored. 

The operator's graphics terminal and control keyboard is shown at the 
lower left of the console layout in Fig. 16 beside the real-time operating 
controls. This terminal will communicate with the host computer having 
executive control , of the experiment. Provision is shown for an on-line 
interactive graphics display terminal with keyboard and built-in hard-copy 
printer, which provides for graphic waveform analysis as well as inspec- 
tion of text. This terminal can also be used to transfer mission 
variables from the host computer to the data acquisition system for 
subsequent display on the graphics terminal shown on the lower right side 
of the console in Fig. 16. An added feature of this last approach is that 
the mission variables being monitored are then available for archival tape 
recording and/or processing by the data acquisition system, the control 
keyboard for which is also located in the extreme lower right comer of 
the console. Fig. 16. 

A programmable multifunction keyboard (viz. , keyset) is also recom- 
mended for inclusion in the lower center of the experimenter's console in 
Fig. 16. Such a keyset is described in Appendix D and can be used more 
easily by the experimenter to set up conditions and configurations with 
single keystrokes as opposed to the formatted, multi-character instruc- 
tions required from the standard host keyboard terminal. The keyset would 
operate through a standard serial (RS-232C) digital interface to the host 
computer. Keyset inputs could be used to call up menus on the CRT inter- 
face, then further keyset Inputs would be used to select conditions listed 
in the menu. These latter commands would call subroutines which would 
communicate with the experimental control software to set up specific 
experimental configurations. An experiment would then be initiated in 
response to further keyset commands. 
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5. Comfort Status Displays (e«g«. Cockpit Temperature) 

and Crev Performance Monitor ^splays and Controls 

Crew "comfort and performance” monitors are shown at the right of 
center on the console in Fig# 16# These monitor panels would consist of 
circular or strip chart recorders and designed to monitor, for example, 
the variety of on-line performance and workload measures suggested in 
Ref# 2 and Fig# 17# Crew comfort monitors, for example, would display 
cockpit temperature and relative humidity as well as the selected psycho- 
physiological variables suggested in Fig# 17# Crew comfort and 
performance data should be displayed at the operator's console to allow 
for monitoring the progression of data as it is acquired in real time 
rather than post hoc# 

Another means of on-line monitoring of crew performance will be to 
provide eye-point-of -regard superimposed on display video# One approach 
will be to use closed circuit TV to monitor the pilot’s display panel# 
Three cockpit video monitors for this purpose are shown at the extreme 
upper right of the experimental operator’s console in Fig# 17# The two 
eye-point-of-regard signals for each crew member are connected to a con- 
sole monitor fran the data acquisition system via D/A converters to permit 
duplex on-line eye scanning monitoring in addition to the preliminary 
statistical analysis which is possible with currently available software 
(e#g#. Ref# 98)# Each pair of eye-point-of-regard signals is also applied 
to its corresponding monitor shown at the upper right of the console in 
Fig# 16# The CRT monitor serves as a flying spot scanner with the display 
video overlay showing relative location of the cockpit displays in the 
pilot’s field of view# The flying spot on the CRT denotes the pilot’s eye 
point of regard# The oculometer processing terminal keyboard is located 
right of center at the bottom of the console next to the data acquisition 
graphics terminal and keyboard# 
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Figure 17. System and Pilot Dynamic Response, Cognitive or Control Capacity, 
and Scanning Workload Measurements for Evaluation (Ref. 2) 









6* Audio IntercoBmunicatlon Controls 

A final capability to be added to the experimenter* s station will be 
the controls for the audlo/communication system# This system will provide 
intercommunication between the experimenter’s station, the traffic conr 
troller, and the cockpit, and allow the Interjection of sound effects and 
other pre-recorded audio information such as procedural instructions# The 
commxmication system shoxild be arranged to allow the experimenter either 
to monitor or to speak over the voice link# This system will provide 
separate recording and reproducing capability# 

7« Malfunction Siimilation Controls 

The malfunction simulation controls will be provided via the program- 
mable multifunction keyboard described above under Item 4# 

Sm Facility Power and Environmental Controls 

The facility power and environmental controls will be located at the 
extreme upper left of the operator’s console# 


This concludes our more detailed review of the experimenter’s console 
and data acquisition system for the advanced technology simulation# A 
prototype for the traffic controller’s console is shown in Fig# 18 from 
Ref# 99. In the next and concluding section of this report we shall sum- 
marize our conclusions and recommendations# 
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SECTION X 


FACILITT INTEGRATION, CHECROOT, AND STAFFING 
A. FACILITY INTEGRATION 

Given a selection of versatile cospatlble simulation equipment, we 
must now consider Integrating the components Into a useful and efficient 
facility. From the experimenter’s point of view the experimenter's con- 
sole and data printers/plotters provide a key facility Interface. These 
devices must be configured and arranged to give the researcher a bird's 
eye view of facility status and subject performance, and provide a con- 
venient means for changing experimental conditions. We have In Section IX 
recommended provision of capability In the experimenter's console which 
repeats the flight deck displays, crew performance Indicators, and In- 
cludes a variety of convenient displays, keyboards, and switches for 
controlling and monitoring simulator configurations. 

An Important feature of the facility Is to provide on-line monitoring 
capabilities for the experimenter. However expenditures for this type of 
equipment are usually traded off against expenditures for storing the data 
In a form which can be readily retrieved for further processing. A common 
method Is to digitize all data on magnetic tape which can then later be 
processed by a larger computer facility, but this approach by Itself, 
while essential for archival storage, does not provide good on-line moni- 
toring for the experimenter, unless, as recommended In Section IX, 
Fig. 14, the digital data Is reconverted to analog form and routed at the 
same time to on-line displays for monitoring at the operator's console. 
For this purpose we have recommended the Inclusion of 16 channels of ana— 
log-to-dlgltal and dlgltal-to-analog conversion Interfaces for each flight 
deck In order to provide for crew comfort and performance monitoring from 
external analog equipment such as circular chart and strip chart 
recorders. 

We have also recommended In Section IX that the facility expand this 
concept to Include experimenter Interaction with several computer 
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teimlnals vhlch will provide computer control, display, and printout of 

t 

simulator status software and summary results. Strip chart recorders and 
on-line data displays are recommended to provide the operator with appro- 
priate on-line feedback of simulator and subject performance. The strip 
chart recorders also serve as a hard-copy record for permanent storage of 
dynamic data In real time which can be readily inspected after the acqui- 
sition of the data. 

B. XMPLEMENTAIION OF SIMULATOR MODELS 

These tasks Involve simulator software and hardware components and 
Include their definition, implementation, and checkout plus the docu- 

mentation of their fidelity. All of these are required prior to the 
initial simulation facility test and evaluation, l.e., the formal taking 
of data. 

1. Definition Phase 

Definition of simulator software and hardware Includes mathematical 
models of the environment (visual, electronic, and atmospheric), models of 
the airframe, all aircraft systems, control hardware, and the display 
design established in the preliminary analysis of scenarios. The major 
objective of the definition phase will be to produce a simulation data 
package. 

2* Implementation Phase 

The actual implementation phase consists of coding of software and 
installation of hardware at the MVSRF. This phase characteristically 
requires several months to execute from time of delivery of the data pack- 
age to start of occupancy on the simulator facility. Engineers should 
coordinate closely with programmers in Implementing model equations and 
being aware of the implications of simulator computer timing, computa- 
tional algorithms, and program set-up. It has been found that failure to 
consider each of these items results in increased simulator check-out time 
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and increased operating problems during the simulation. Pitfalls to be 
avoided in the implementation include an excessive disparity between the 
simulator model document supplied by the engineers and the eventual simu- 
lation program as implemented by coding personnel. 

3. Check-Out Phase 

The check-out phase consists of the performance of check cases based 
on pre-computed results, the evaluation of check case results, and simu- 
lator trouble-shooting as required. The checking sequence to be applied 
will begin with basic airframe and propulsion system equations of motion 
and progress outward through the various navigation and guidance loop 
structure features until all aircraft systems have been checked. Quanti- 
tative functional checks will then be applied to cockpit control hardware, 
cockpit displays, and the simulator visual system hardware and software. 
Several forms of quantification will be used in the check-out phase and 
will Include the static trim points, direct measurement of stability and 
control derivatives, direct measurement of describing functions, discrete 
responses to controls, comparison of time histories using overlays, and 
calibration of displays and visual scenes using direct overlays. 

Although it Is desirable to use the host computer for automatic simu- 
lation control, manual backup modes should be provided for in order to 
allow for debugging, component testing, special experimental control, and 
.other non-routine task-scenario operations without having to reprogram the 
computer. The simulation must initially be checked out and demonstrated, 
and the check cases should be automated so they can be used routinely to 
verify proper simulator functioning. Two levels of checkout should be 
provided: one for a simple dally check before running subjects; and 
another more detailed set of tests to be used for thorough simulator vali- 
dation and debugging of malfunctions. These checkout fimctlons would be 
provided through a combination of computer routines and experimenter's 
console controls. 
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4. Fidelity Documentation 


The final and perhaps most crucial step In the simulator Implementa- 
tion task will be documentation of simulator fidelity for the specific 
tasks to be considered. While documentation of fidelity Is handled to 
some extent In the check-out phase, It will be necessary to employ a 
qualified pilot In order to quantify the most explicit aspects of simu- 
lator fidelity. The explicit fidelity Items Include the pilot's 
perceptual and control technique behavior which Is Induced by the simu- 
lator. The procedure will consist of the pilot flying several well- 
defined, routine tasks. In some cases the piloting behavior observed In 
the simulator can be compared directly with existing flight data or the 
simulator results can be stored for eventual comparison with flight data 
when available. 

C. SIMOLAXION TEST PLAN DEVELOPMENT 


What amounts to the final step in the facility Integration and check- 
out and the first step in the simulation facility operational test will be 
development of an efficient simulation test plan. 

1. Task Analysis 

The development of the simulation test plan will require development 
of a scenario and a detailed task analysis to establish the normal and 
emergency procedures for each crew member, the probable task loop struc- 
tures, level of perception (compensatory, pursuit, or precognitlve), and 
the required or desired loop bandwldths. Examples of the task analysis 
appropriate to the full mission simulation scenario have been analyzed In 
Refs. 7 and 100, Other recent task analysis efforts for approach and 
landing have been Included In Refs. 1 and 2. Procedures have been estab- 
lished for the quick and efficient gathering and analysis of simulation 
data In order to quantify any task of interest. Quantification of flying 
tasks can be handled for either direct reference to cockpit Instruments or 
reference to an outside visual scene. We explain in Appendices A and B 
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how quantification of actual flight maneuvers can be used to establish and 
document basic simulator fidelity. 


2. Unmanned Simulation of Tasks 


The next step in the test plan development will be to exercise an 
unmanned simulation of the tasks previously analyzed. The conditions to 
be varied will Include vehicle and aircraft systems, their levels of deg- 
radation, and environmental factors such as turbulence, wind shear 
profile, and daytime versus nighttime. The objective of this unmanned 
simulator exercise will be to establish meaningful levels of disturbances 
for the manned simulation. Primary metrics will be rms dispersions or 
absolute peak variations in the outer loop position states for each of the 
tasks to be considered. One matter of particular Interest in the unmanned 
simulation will be determination of the criticality of visual system lags 
and delays. Past experience with the VFA-2 and VFA-7 Redifon visual sys- 
tems at Ames Research Center have produced a keen awareness of the visual 
system fidelity pitfalls for tasks involving control of aircraft position. 


3. Layout of Test Plan and Schedule 


The final step in the test planning will be a detailed definition of 
test cells, their approximate time for running, and their most efficient 
sequential order. Based on past experience with simulator programs of 

this type, it has been found that: 

• Barring the need for the ultimate full mission simu- 
lation involving several hours, facility test sessions 
involving all three crew members should be not shorter 
than 60 minutes and not longer than 90 minutes. 

• Only a very restricted number of tasks should be con- 
sidered during any one test session. It is often most 
effective to restrict the session to a single task or 
mission segment. 

• The environmental conditions for each run should be 
sufficiently unpredictable to ensure that the crew is 
flying the aircraft rather than relying on learned simu- 
lator response. 
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D. STAFFING 


The personnel required to operate and maintain the simulator are 
recommended based on our extensive operational experience with automotive 
and aeronautical research simulators. This experience Indicates that five 
fields of knowledge and expertise are required as follows: 


1. Experimental Designer . This Individual generally works 
with the Principal Investigator to define the proce- 
dures, tasks, measures, and methods of analysis to be 
used In a given simulation. He also oversees the 
activities of the other members of the team. 

2. Simulation Operator. This Individual generally operates 
the simulation during experimental runs. He Is Inti- 
mately familiar with the whole simulation and routine 
on-line troubleshooting procedures. 

3. Crew Performance Analyst . This Individual assists the 
Principal Investigator at the experimenter's console In 
Interpreting the on-line performance measures described 
In Ref. 2. More than one analyst, each with different 
skills, may be needed, for example, to Interpret the 
procedure-centered, system-centered, and human-operator- 
centered measures described In Ref. 2 

4. Crew Observer . This Individual assists the Principal 
Investigator In the flight deck by observing crew opera- 
tions directly and recording his observations and 
Interpretations of events. The observer should possess 
the qualifications of a flight officer. He will, in 
addition, serve as the simulation check pilot. 

5. Electrical Technician. This Individual can repair and 
modify the electrical Interfaces and components not 
covered under warranty. 

6. Mechanical and Optical Technician. He is responsible 
for maintenance and special-purpose modification of the 
mechanical and optical equipment. 

7. Minicomputer Programmer . This Individual is necessary 
to maintain the software requirements of the simulation 
system. 


We recommend that two Individuals possessing each of these skills be full- 
time staff ' members of the facility and that additional programmers be 


TR-1 156-3 


154 



procured as required for initial software development and subsequent ad- 
ditions to the software. It will be most cost effective to contract for 
some special equipment maintenance such as that for the graphics generator 
hardware, digital computer(s), and primary control loading devices. Sig- 
nificant contract maintenance costs have been estimated for this special 
equipment, respectively in Tables 11 (Section III) and 17 (Section VI). 

Finally, the overall simulation facility must be laid out with several 
considerations in mind: 

• Proper environmental controls for the simulation 
hardware. 

• Convenient arrangement for experimenter interactions 
with the equipment and subjects. 

• Temporary work space for researchers. 

• Shop area for equipment maintenance and modification. 

• Suitable areas to brief and debrief subjects. 
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SECTION XI 


CONCLUSIONS ^ RECOMMENDATIONS 


Putting together the foregoing facility organization, fidelity cri- 
teria, and critical operational scenarios, as well as the environmental, 
vehicle, crew station, visual, motion, control feel, and computational 
reqiiirements, leads to a recommended overall Man-Vehicle Systems Research 
Facility plan which is summarized in Table 21. The bases of our recom- 
mendations for each item, and a more detailed breakdown of the specific 
functional requirements have already been given in each previous chapter. 

A main point we wish to make here is that high quality, research grade 
equipment should be specified throughout the facility. However one must 
guard against facility "over-building" which has plagued several large 
simulation facilities recently. By taking advantage of gradual buildup of 
the more expensive items, as suggested herein, the costs may be held to 
nominal levels and the facility need not be over-built at the outset. 

We believe that a simulation facility meeting the requirements out- 
lined herein would accommodate most foreseeable man-vehicle systems 
research problems in commercial air transportation with high effectiveness 
and reasonable cost. 
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TABLE 20 


RECOMMENDED MAN-VEHICLE SYSTEM RESEARCH SIMULATION FACILITY 


Cooputcr Digital; dlscrlbuced procttsort (four locorrtlated functions) 


• Host (ens ssch for Current Technology. Advanced Technology, and Air Traffic Control) 
o Visual Field and HUD (one each for Current Technology and Advanced Technology) 

• Display Graphics (Advanced Technology) 

• Data Acquisition (one each for Current Technology and Advanced Technology) 


Cockpits 


a Two 4->place transport flight decks, each with optional grovth provisions for action systea 


a Advanced technology designed to accept panel-isounted calligraphic and raster graphic visual 
display units, nodular feel simulation units, intercom, and sound generators 


a Current technology based on contemporary training simulator flight deck 


Vlsxxal Field Display Cockplt*-aountcd displays plus collimating lens units 

a Central field: Two 21-lnch 800-llne color monitor CRTs 

(CTOX.) Good quality. ± 45 deg fleld^'of-vlew colllmatlon lenses, close to pilot and 
copilot 

a Farafoveal field (Optional growth provisions): two to«foar 27*lnch 550 line color CRTs. 

(STOL) with colllmatlon lenses 

a Optional grovth provisions for Interposing framing, displays. HUD. or poor visibility between 
CRT and lens 


Effective overall response time delay from the pilot’s viewpoint, t < 0.04 sec (Including host 
computation) 

Moving Base — (Optional grovth provltlons for two S*dcgrce-of'-freedom systems) 

a Linear travel: * 10 ft (5 ft min) lateral and vertical 
a Angular travel (min): Pitch ± 30 deg. Roll ± 45 deg. Yaw ± 30 deg 
a Frequency response at 50 percent travel: 

Linear : Flat to 1 Hz. Effective time delay, t < 0.2 sec 

Angular : Flat to 2 Hz. Effective time delay, t < 0.1 sec 

a Other: Smooth and vlbratloi^free 

Control Feel Systems (Interchangeable modules) 

a Basic Mechanical Module — two sets (three axes each) —> two sizes 
a triable Force Producers — two modules (one axis each) 
a Servo Actuator Simulators — — two modules (one axis each) 

Air Traffic Control 


) 


a Functional representation of terminal ATC with at least three controllers: two area axsi 

terminal 

a Flexible and realistic Intercommunication among at least three pseudopilots anl both flight 
decks. 

a Zodependent and simultaneous operation of both flight decks In the same airspace. 
Ezperloentar’s Console 

a Current technology based on contemporary Instructor's console for training simulator 
a Advanced technology designed to accept visual display monitors and programmable multifunction 
keyboard, as well as the following functions. 

(1) Performance monitor systea 

(2) Crew comfort monitor systea 

(3) Systea malfunction controls 

(4) Data acquisition controls 

(5) Operating controls 

(6) Cmaunlcatlon controls 

(7) Eovlronaental controls 

Data Acquisition Media and Special Equipment (Including data conversion) 

a Soft copy (e.g*. magnetic) 

(1) Audio 

(2) Video 

(3) Coded digital signal data 

a Hard copy (e.g.. oscillographic data, digital data) 
a Eye-Polnt-of-Regard 
a Fsychophyslologlcal 

a Any other special measures not included In simulation computers 

(1) System bandwidth 

(2) Describing function, remnant 

(3) Excess control capacity 

(4) Excess cognitive capacity 

a Signal format and conversion equipment (A/D, D/A. D/0) 
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APPENDIX A 


A UNIFIED MEASURE OF VISUAL FIELD FIDELITY 


The manually controlled decelerating approach to a hovering condition 
In a helicopter has been described as a tlme—varylng maneuver for uhlch 
closed-form solutions of the linear differential equation describing the 
range-dependent kinematics are not evident (Ref, A-1), A slightly altered 
differential equation has been formulated, however, In Ref. A-2, which 
combines the crossover model of the pilot-vehicle combination (Ref. A-3) 
with the effects of visual perception (Refs. A-4, A-5, and A-6) and yields 
a simple manual deceleration guidance law which agrees well with In-fllght 
measurements of the range-dependent kinematics (Fig, A-1), which accompany 
the pilot’s control actions. Although the visual manual deceleration 
guidance law Is time-varying. It permits closed-form solutions for speed, 
acceleration, and time as fimctlons of range to the hovering point. One 
potential use of the deceleration guidance law, which concerns us here. Is 
as a simulator validation tool by comparing simulator measurements with 
In-fllght measurements of the parameters A and k In the deceleration gui- 
dance law (Fig. A-1) while the helicopter Is under visual manual 
control. In addition the same Ideas applied to the deceleration task In 
Fig, A-1 can also be extended to vertical and lateral flight path 
guidance. 

The key to describing (and measuring) the fidelity of the visual per- 
spective (Fig, A-1) Is provided In Ref. A-5 where the psychological 
measurements of apparent range and apparent size of essential cues In the 
visual field are related to various metrics of visual perspective. There 
It Is shown that perceived range, Rp, Is related to true range, R, by: 

R - R 
p 1 + R/A 

where the length A Is a characteristic measure of perceived range known as 
the apparent distance of vanishing points from the principles of 
perspective. 
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Analytical model of deceleration guidance 

dt P I + R/A 

O Flight test dota for one typical deceleration 
maneuver starting at 80 kt airspeed and 
1000 ft altitude 



Figure A-1. Comparison of Deceleration Profiles Between Analytical Model and Flight Test Data 




Likewise, perceived size, Sp, is related to objective true size, S^, 
by: 

S R , 

_E . _E „ L_ 

S R 1 + R/A 

o 

The value of k in the guidance law can be interpreted as the crossover 
freqi«ncy of the pilot-vehicle system, which represents the psychomotor 
bandwidth achieved by the pilot in the control task. Values of A and k 
identified in Ref. A-2 from the decelerating helicopter flight tests in 
Ref. A-1 are given in Fig. A-1 for eventiuil comparison with corresponding 
measurements from simulator tests. 

Independent out-of-doors field measurements of A were made over twenty 
years ago by an entirely different technique using comparative apparent 
size judgments of two plain white isoceles triangles in daylight and re- 
ported in Ref. A-6. One of the isoceles trianges, called the "standard," 
was of constant physical size, but was viewed by the subjects at ranges 
varying from 100 to 4000 ft. The physcial size of the other Isoceles 
triangle was adjustable by the subjects, but the triangle remained at a 
constant range, r^ = 100 ft, and 36 deg to the right of the direct line of 
sight to the standard triangle in order to prevent simultaneous foveal 
viewing while the adjustment was being made to match the apparent size of 
the standard. The experimental site was a fairly level stretch of grassy 
terrain and the direct line of sight was parallel to an Inactive airport 
runway 5000 ft long. 

Since the adjustable triangle is always at range r^, its perceived 
size will be Sp •* | 4 . " r ' /a * where s is the adjusted (objective) true 

size. The constant size triangle is giewed at varying ranges R, therefore 
its perceived size will be Sp = T’hFrTa* ^ constant. The 

subjects were instructed to adjust s so that Sp “ Sp while using binocular 
vision. The resulting objective size measurements are then related by 


s 


S 

o 


A + r 

o 

A + R 


(1-^) 
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The length A is thus the subjectively perceived range at uhlch the size 
ratio s/Sq tends to vanish. The mean out-of-doors field value of A ex- 
trapolated from the measurements In Ref. A-6 was 300 ft. 

More recently, similar out-of-doors field measurements in daylight 
have been repeated and compared with measurements derived from analogous 
tests while the same subjects viewed collimated and uncollimated closed- 
circuit TV monitors displaying the same out-of-doors tests. The results 
for A have been calculated and are listed below based on data from 
Ref. A-7. 


Out-of-doors, daylight 530 ft < A < 680 ft 
Collimated TV monitor, daylight 216 ft < A < 239 ft 
Uncollimated TV monitor, daylight 66 ft < A < 115 ft 

These results for A imply that the colllmatlon tended in part to com- 
pensate for the distortion of the visual perspective associated with 
direct viewing of the TV monitor*. The range of "out-of-doors" values for 
A Is approximately the same as the range of values for A estimated from 
the helicopter deceleration flight tests in Fig. A-1. 

Other analogous measurements have been derived from tests wherein the 
subjects viewed computer-generated Imagery (CGI) consisting of calli- 
graphic night visual scenes of an airport runway beside which the standard 


* See Ref. A-8 for results of flight tests of blind landing performance 
using closed-circuit TV displays with Iconoscope lenses having different 
focal lengths. The average error in touchdown point varied in linear 
proportion to the focal length of the lens. Thus: 

1) Angular magnification, as with a telescopic lens, caused more 
undershoots (angular magnification tends to increase A) 

2) Duplication of the perspective caused no mean bias in 
touchdown error 

3) Angular reduction, as with a wide-angle lens, caused more 
overshoots (angular reduction tends to decrease A) 
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and variable triangles were alternately presented for comparative judg- 
ment* These results are reported In Ref. A-4, also for collimated and 
uncolllmated viewing. Again the results for A have been calculated and 
are listed below based on data from Ref. A-4. 

Collimated CGI, night scene 76 ft < A < 170 ft 
Uncolllmated CGI, night scene 24 ft < A < 70 ft 

Since the comparable out-of-doors night scene was not tested for compari- 
son, one Is left to speculate among hypotheses for the much lower ranges 
for values of A. Again, however, the beneficial contribution of colllma- 
tlon is apparent in Increasing the range for A. 

SUMMARY 

The apparent distance. A, of vanishing points in the visual perspec- 
tive can be estimated from a variety of experimental tests in flight and 
in simulators. The values of A so obtained offer a unique measure of the 
fidelity of visual perspective for application to the simulated visual 
field devices. 
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APPENDIX B 


EFFECTS OF VARIOUS LATERAL-BEAM-MOTION WASHOUTS 
ON PILOT TRACKING AND OPINION IN THE "LAMAR" SIMULATOR 

(REF. B-1) 


A series of moving-base flight simulator experiments has been recently 
performed using roll and sway motions of the Large Amplitude Multimode 
Aerospace Research Simulator (LAMARS) of the Flight Dynamics Laboratory at 
Wrlght-Patterson Air Force Base, Ohio. 

The pilot's task was to follow an evasive (randomly rolling) target 
while suppressing gust disturbances. A two-independent-input technique 
produced behavioral data (describing functions) and performance data 
(error and control scores), which revealed how pilots used the visual and 
motion cues. Subjective data was also gathered on the tracking task as 
well as on limited "sidestep" maneuvers. 

The objectives of these experiments were: 


1. To tie in the roll-only visx:al-and-motion simulation 
results of the four experienced pilots with previous 
results (Ref. B-1) for four well-trained nonpilot 
subjects. 

2. To investigate effects of various lateral-beam-motion 
"washout" filters designed to keep the lateral sway 
within the ± 10 ft of LAMARS travel, (lateral beam sway 
is used, within limits, to imitate the realistically 
"coordinated" lateral motions of free-fllght roll 
maneuvers.) 


We shall now present some of the results which characterize the pilots' 
judgments of "realism." 

Although the pilots were encouraged to use their own words to describe 
the effects of the motion cues, there was a certain amount of commonality 
in the terms used by all the pilots. These are summarized below: 


1. "Delayed side forces": These were side forces that were 
seemingly uncorrelated with the roll motion of the 
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aircraft. The specific force, a , was not completely 

^ cab 

eliminated by translational acceleration, » only 

attenuated and delayed by the sway axis washout 
filter. Some pilots said this felt like a student kick- 
ing on the rudder pedals. 

2. "The leans": These were side forces that were perfectly 

correlated with the roll motion of the aircraft. The 
pilots described "the leans" as a pressure either on 
their knees or shoulders against the bulkhead of the cab 
when they knew their aircraft was rolled either left or 
right. Some pilots commented that when they were ac- 
tively involved in the roll tracking task they did not 
notice "the leans" but the "delayed side forces" could 
be disconcerting. 

3* "Change in the effective roll axis": The pilots felt 

that the effective roll axis was above them for roll- 
only motion. However for ccanbined roll and sway motion 
the pilots could discern changes in the effective roll 
axis for various types of sway axis drive logic (i.e., 
various combinations of and This made the pi- 

lots feel as if they were on the end of a variable- 
length pendulum as Ky and were changed. 

4. "Change in stick sensitivity": Although not a consis- 

tent comment, some pilots could discern changes in the 
effective stick gain for various types of sway-axis 
drive logic. This affected their impression of the task 
difficulty (e.g., "easier to fly now," or "more diffi- 
cult to track now"). 


The pilots’ subjective impressions of the motion cues, as described 
above, were used to define boundaries of acceptable combinations of the 
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parameters of the sway-axis -washout filter. The resulting "boundaries” 
are summarized in the plot of Ky verus Wy shown in Fig. B-1 (from 
Ref. B-1). The boundaries shown in Fig. B-1 intentionally appear nebulous 
for three reasons: 

1. Pilot comments were not always repeatable, and many 
times the pilots admitted that the changes in the motion 
cues due to changing Ky and Uy were very subtle. There- 
fore only relative judgments could be rendered, and the 
pilots' subjective Impressions of the motion cues were a 
function of the starting points of the Ky, Uy combina- 
tion. The pilots were not told which combination of Ky 
and (Dy was being used, but they were told when a change 
in the value of either Ky or Uy was made. This experi- 
mental technique was adopted because it was very 
difficult for the pilots to rate the motion cues on an 
absolute scale. 

2. Pilot comments changed with the magnitude of the tar- 
get's randomly rolling motion. The pilots were much 
more sensitive to changes in Ky and/or Uy for the larger 
rolling amplitude than for the reduced amplitude. The 
difference in the pilot commentary is probably due to an 
indifference threshold on specific force (Ref. B-2 re- 
ports the Sy indifference threshold to be approximately 
0.1 g). 

3. Pilot comments changed with the task. This too was 
probably related to the pilots' Indifference thresholds 
to specific force. For example. Fig. B-2a summarizes 
some pilot comments on a plot of peak ay versus Uy for 
Ky “ 0.9. For bank and stop (sidestep) maneuvers the 
side forces become "disconcerting” when ojy is greater 
than 0.4 rad/ sec (note that this is where the Sy peaks 
become greater than 0.1 g), but for the tracking task 
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Figure B-1. Boundaries of Sway-Axis Washout Filter Parameters 
(From Ref. B-1) Which Delineate the Pilots’ Impressions of Realism 
from Combined Roll and Sway Motion Cues 
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O Bank and slop maneuvers. 
o Roll tracking with "reduced" inpul 


a) PEAK SPECIFIC FORCE VS. Wy AT Ky - .9 



b) PEAK SPECIFIC FORCE VS. Ky FOR cOy - .3 rad/sec 



Figure B-2. Summary of Pilot Commentary for Bank 
and Stop Maneuvers and Roll Tracking 
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with the reduced input the pilot said "no difference" 
between “y ■ 0.3 and 1.0 rad/sec (note that the ay peaks 
just reach 0. 1 g for “y ■ 1.0 rad/sec). A similar phen- 
omenon occurred when “y was fixed and Ky varied, as 
shown in Fig. B-2b. Also note from Figs. B-2a and B-2b 
that for small values of Ky with “y “ 0.3 rad/sec the 
pilot complained about the "leans," whereas for large 
values of <^y with ^ ■ 0*9 the pilot complained about 
"lagged side forces." 


Finally one other Important comment was the pilots* universal dis- 
pleasure with hitting the sway displacement limits. The adverse effects 
of hitting displacement limits have been observed in other simulators 
(e.g. , Ref. B-3) and should be prevented by adopting nonlinear motion 
drive logic. 

The nonlinear washout filter had the predicted attribute of preventing 
the sway displacement from hitting the LAMARS limits, because the amount 
of lateral travel used is extremely sensitive to “y (recall that «y is 
self-adaptive for the nonlinear filter). Otherwise back-to-back com- 
parisons of the linear and nonlinear washout filters with the same value 
of Ky revealed no consistent differences in the pilots' subjective impres- 
sion of the motion cues. The tracking scores obtained with the linear and 
nonlinear filters were virtually identical, and the pilot describing func- 
tions were also the same. However the amount of lateral travel used by 
the nonlinear filter was usually 30 percent less than that used by the 
linear filter during roll tracking. Except for occasionally greater 
peaks, this reduction in lateral travel was not otherwise accompanied by 
an Increase in specific side force, ay. 
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APPENDIX C 


CONTROL-FEEL SYSTEM CHARACTERISTICS 


We group the types of aircraft controls into two main categories: 

1, Primary controls which include the "operating controls" 
(column, yoke, stick, pedals, throttles, thrust modula- 
tion devices, etc*) and the active trim controls (trim 
wheels, levers, beeper buttons, etc.) 

2. Secondary controls which include various selector con- 
trols (speed brake operations, thrust reversers, flaps, 
slats, landing gears, etc.) 

The feel properties which must be simulated for these classes of con- 
trols are shown in Table C— 1. The remainder of this discussion is 

concerned with simulating the primary operating controls, where the fidel- 
ity of dynamic interaction with the pilot is of paramount Importance. 

Among the control-feel system characteristics which must be specified 
are the control displacement ranges, the force gradient characteristics 
for various flight regimes, and various nonlinear properties (e.g., pre- 
load, friction, and backlash). The control feel dynamics include the 
elastic and inertia characteristics, as well as force feedback effects 
from the servo actuator system itself (e.g., bottoming forces due to valve 
flow limitation, valve friction, and surface stops). 

These feel characteristics have differing levels of importance for 
different classes of vehicles which are governed primarily by the role 
that the control-feel forces play in the more difficult control situa- 
tions. The situations which define the control-feel system requirements 
are illustrated in Table C-2. The transport classes have been divided 
into: (a) conventional takeoff and landing, and (b) short takeoff and 

landing vehicles. For large conventional aircraft the crucial control- 
feel system requirements are the displacement ranges and dynamic force 
feedback effects. For STOL aircraft the control-feel system requirements 
center around the force gradient ranges, the numerous nonlinear features 
which make control difficult, and the dynamic characteristics of the feel 
system which can become closely coupled with the vehicle dynamic response. 
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TABLE C-1 


COCKPIT CONTROLS AND FEEL CHARACTERISTICS 


Class of Controls 

Typical Transport Feel Characteristics Required 

CTOL 

STOL 

Primary 



• Operating Controls 



Column^ Yoke^ or Stick 

Preload, control system dynamics, feel gradient 

Pedals 

Preload, friction, gradient, control system dynamics 

Throttle levers 

Detents, adjustable friction 

Powered-Lift or 



Thrust Modulation 


De tent , f r let ion 

Conversion Manipulator 


Adjustable friction, detents 

• Trim Control 



Handwheel or Lever 

Adjusts 

ible friction 

"Coolie Hat" 

Detent 


Beep Trim Functions 



(e.g. » thrust 



deflector angle) 


Spring centering gradient 

Secondary 



a Selector Controls 



Speed Brakes 

Detents, stops 

Detents, stops 

Thrust Reverse r 

Detents 

Detents 

Flaps and Slats 

Detents 

Detents 

Conversion Lever (step) 


Detents, Adj. Friction 

Landing Gears 

Detents 

Detents 




TABLE C-2 


SITUATIONS DEFINING CONTROL REQUIREMENTS 


Feel Characteristics 

Vehicle Class 

CTOL 

STOL 

0 Displacement ranges 

(e.g., nonlinear gearing, extremes) 

/ 


• Force gradient dynamic ranges 

(e.g., dual or multi-gradients, 
maximum-minimum range) 


/ 

• Nonlinear features (static) 

(e.g., detents, stiction levels, 
backlash, etc.) 


/ 

• Dynamic effects 

• Control system elastic and inertia 
characteristics, hysteresis and 
friction 

• Actuator effects (e.g., valve flow 
forces, friction, rate limit) 

1 

1 

/ 

/ 

✓ 

/ 
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1. FDHCTIONS TO BE SIMOLATED 


Proper simulation of the detailed forces felt by a pilot can be ex- 
tremely complex. Three types of forces are present: (a) basic column- 
yoke forces from the mechanical-inertial properties of the column, yoke, 
and cable or push-rod system, (b) bobweight forces from intentional or 
inadvertent mass unbalance in the system, and (c) servo actuator force 
feedbacks when a fully powered hydraulic control system is employed. 
These are shown in Fig. C— 1. Even in the simplest simulation, at a fixed 
flight condition, and for conditions where the servo— actuator forces are 
negligible, one must simulate the proper control system friction breakout 
and apparent inertia. Pure viscous friction is seldom present in a basic 
mechanical column— yoke design (although it is often used to represent 
Coulomb friction) and viscous column dampers are seldom added to the sys- 
tem because their presence has usually been found to be adverse (one 
exception is when bobweights are used to increase feel forces). Feel 
changes due to d3mamic pressure and due to the bobweight effects are next 
in likelihood of occurrence. Hydraulic servo actuator forces are usually 
of greatest concern when large control motions and rates are required, but 
the valve centering forces can be of importance even for the other flight 
conditions. More detailed references on the nature of these characteris- 
tics and their importance may be found in Refs. C-1 through C-4. 

From the standpoint of the simulation system rather than the aircraft 
control system, the feel forces can be regrouped into three categories: 
(a) linearized forces including inertia, spring rate, and any viscous 
friction; (b) flight-dependent forces such as dynamic pressure feel and 
bobweight forces; and (c) nonlinear forces such as friction, preload, 
^alve forces, etc. , The basic linear and flight— dependent forces have 
only a modest bandwidth (on the order of a short-period frequency) while 
the nonlinearities require an extremely wide bandwidth for proper simula- 
tion (on the order of 100 Hz bandwidth or greater). To simulate all these 
characteristics with reasonably acceptable fidelity in a single force 
producer package coupled with an analog computer mechanization of the 
nonllnearltles is an extremely difficult, expensive, and time-consuming 
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Figure C-1. Elements of Control Feel System Characteristics 











proposition. For example, the best such systems known to us (built by 
McFadden Electronics Company) cost on the order of $100,000. They Include 
three axes of control and simulate some nonllnearltles, require a hydrau- 
lic power supply, but do not Include complete analog computer requirements 
or mechanical Interconnection between pilot's and copilot's controls. 
Because even the simplest simulation setup will require simulation of 
friction and preload, multiple units of this type would be required. 

The McFadden equipment uses lightweight low friction rotary actuators 
with hydrostatic bearings connected to the appropriate aircraft 
controls. The electro-hydraulic actuators are commanded by electrical 
analog force commands from a servo function-generating console Incorpora- 
ting fail-safe circuits to stop unsafe control motion. The actuators 
provide a smooth response at low spring gradients, and artificial feel 
characteristics can be easily modified, if it be desired to change the 
generated aircraft feel characteristics. 

Simple dial adjustments of artificial force feel characteristics, such 
as spring, damper, preload, and friction, can provide an operator with 
realistic "feel" cues as if he were at the controls of any vehicle. 
Including those in design. Systems are available using any combination 
of: 

• One-axis, pitch, stick 

• One-axis, yaw, rudder pedals 

• Two— axis, pltch/roll stick, or control column/yoke 

A separate deck of electronics Is supplied to control each mechanical axis 
and Is rack mounted In a compact electronic cabinet. 

Whereas a fully powered hydraulic feel simulator of the type just 
described may be more desirable for the current technology flight deck, it 
would appear not to be as cost-effective for the advanced technology 
flight deck in which low inertia pedestal controllers are envisioned. 
Obviously a more practical solution is needed for the advanced technology 
flight deck. This Is the electromechanical modular feel package to be 
described next. 
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2. MODULAR FEEL PACKAGES 


After examining the simulation situation matrix of Table 5 
(Section I), the foregoing material in this appendix, and our own exper- 
ience with either consulting or building feel simulation units, a modular 
feel package concept has emerged# Several “basic mechanical feel modules” 
are provided to simulate the basic controller forces, a “variable force 
module” is used to simulate the Q-feel, multiple spring gradients, bob- 
weight, and trim forces (and certain low bandwidth nonlinearities) and a 
”power*-servo-simulator module” is provided to simulate the complex servo 
force feedbacks# By arranging the design so that each of the three basic 
modules can be coupled to the same control axis and by providing more of 
the cheaper mechanical units and fewer of the expensive variable force 
units, a high degree of operating versatility can be achieved within prac- 
tical cost limits# All the elements in these modules have been built and 
operated in the manner recommended here (e#g#. Ref# C-2)# 

The basic mechanical module is coupled to a low Inertia column or 
pedal assembly. Two sets of such assemblies should be designed, one to 
handle current technology aircraft, and another to handle advanced tech- 
nology aircraft# Every effort should be made in the design of the columns 
and pedals to reduce the inertia to the minimum possible so as to be able 
to simulate a low inertia system in a passive manner# 

The mechanical feel package is coupled by a jackshaft and pushrod to 
the control column# It comprises a mechanically variable inertia (e.g#, 
through a variable gear or belt arrangement), an adjustable linear spring 
gradient, and cam-type preload and friction devices# The spring gradient, 
preload, and friction can be adjustable either by hand cranks or by a 
simple motor-driven jack screw# As in the case of the control column 
assembly, two pair of mechanical feel packages would be provided having 
different intrinsic ranges of variables to handle the two main classes of 
problems mentioned previously and to provide lower forces in the roll axis 
than in the pitch axis. The advantage in using such simple mechanical 
feel packages is that they are inexpensive, reliable, and are easily tai- 
lored to a given aircraft type# They provide excellent simulation of the 
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important nonlinearities of friction and preload without incurring simula- 
tor lags or artifacts. Low inertia, simple spring gradient manipulators 
may easily be simulated when one wishes to remove the feel system charac- 
teristics from the problem. Furthermore a noisy and unreliable hydraulic 
power supply system is not necessary for the majority of simple simula- 
tions, which will use this mechanical feel module alone. A standard 
design \init can be employed which is compact and straightforward with 
variations in the specific elements to accommodate the different general 
types of force requirement. It is possible to start with a simple three 
axis set of modules and to build others as time and problems require. 

The second element in the feel simulation system is the variable force 
module. This unit is Intended to provide modest bandwidth, analog com- 
puted force Inputs such as Q-feel, multiple spring gradients, bobweight 
forces, trim forces, and some low bandpass feel nonlinearities. It does 
not have to handle extremely high bandwidth force feedbacks such as pre- 
load, friction, etc. The variable force module could be of the classic 
force-producer type (l.e. , the position of the element is sensed and the 
required force is commanded whereupon the closed-loop force producer sys- 
tem reproduces the commanded force). Alternatively, it can be of the 
"force-sensed position-commanded" type in which the force on the control- 
ler is sensed by a stick transducer and the resulting displacement of the 
element in response to this stick command is computed on the analog com- 
puter. The commanded stick position is then achieved by a high bandwidth 
positioning servo system. For overall simulations, the latter system has 
been found to be more trouble-free and easy to achieve. However satis- 
factory units of the former type are now available commercially (e.g., 
McFadden Electronics Company sells force producer units for under $10,000 
each, depending on the bandwidth requirements). The specific choice bet- 
ween these two depends on factors beyond the scope of this investigation. 

The advantage of the variable force module is that one basic design 
can be used on all simulation setups, since the forces it has to provide 
are small ones, added to the basic mechanical forces which are already 
provided by the mechanical feel module. If three such variable force 
modules are provided they can be used altogether on one three axis 
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simulation or separately on different simulations. The design of the 

mechanical unit should be such as to accept the variable force module 
input as one input on the jackshaft. The variable force module can also 
simulate some displacement sensitive effects such as multiple gradient 
springs, nonlinear Inertia due to four-bar linkage effects, and cable 
compliance effects. In a pinch, it may be used to simulate the low band- 
width portions of certain servo actxiator force feedbacks such as a "soft" 
valve bottoming and valve centering forces. 

The correct simulation of a power servo actuator system is an ex- 
tremely complex process In itself (e.g. , see Ref. C-5) and is not 
recommended for the facility. On the other hand, we have found that an 
excellent simulation of the significant properties can be obtained quite 
inexpensively by using a specially modified small hydraulic servo actiiator 
to serve as an analog for a larger unit. This is possible because only 
the small valve force properties of the servo actuator need be provided by 
the simulator, and these are always on the order of a few pounds or 
less. We recommend that a power— servo— simulator— module be provided which 
consists of a small hydraulic servo with an exaggerated valve travel. 
Valve friction would be provided externally, being adjustable by manual or 
servo means. The flow forces due to valve overlap or underlap can be 
provided mechanically with certain types of barrel servo valve. Flow rate 
effects can be provided by scaling the plckoff sensitivity relative to the 
mechanical travel. Compliance effects will also be simulated mechanically 
through a variable stiffness leaf spring. The design of such a unit is 
fairly straightforward; we have built and operated one quite successfully 
in past research (Ref. C-2). 

The advantage of the power-servo-slmulator unit is that it provides 
the simplest possible simulation of a set of very complex nonlineari- 
ties. Since large forces are not Involved, very small and inexpensive 
units can be employed. Two or three such units would suffice for the 
whole facility since servo— valve nonlinearities are seldcxn limiting in all 
three axes during the same problem. They can be acquired gradually so as 
to minimize the costs and maximize their utilization. 
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For a given cockpit the recommended primary control feel simulation 
system thus consists of a basic mechanical module for each control axis, a 
variable feel module for at least the pitch axis and possibly others, if 
required, and a power servo simulator module when required* The variable 
feel and power servo modules would be designed to attach or detach easily 
from the basic mechanical module to permit easy interchange between the 
various simulation setups* 
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APPENDIX D 

PLASMA DISPLAY TEBMINAL AND 
PBOGBAMMABLE MULTIFUNCTION XEYBOABD 


Instrumentation Technology Corporation 
Northridge, California 
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ITC MODEL 965A 


PLASMA DISPLAY TERMINAL 


GENERAL 

The ITC Plasma Display Terminal is a flexible, easy-to-use controller 
which can be used with any system that is RS 232 compatible. It 
“looks** and can be used as a teletype to a computer system, but can 
also be used for many different applications. Human-machine inter- 
face, a major aspect of the design, is accomplished through a 
programmable graphic display, with built-in operator touch control. 

The heart of the system is a Digital Equipment Corporation LSI-11 
microcomputer, which is software compatible with the PDP-11 family 
of minicomputers. The availability of extensive LSI— 11 software makes 
the Model 9654 well suited to also be used as a stand-alone computing 
tool. 

FUNCTIONAL DESCRIPTION 

The display panel is an- 80 x 256 dot matrix plasma display. Using 
microprocessor contTol, alphanumerics as well as graphics are dis- 
played. As many as 288 characters (5X7 dot matrix) are displayed 
in the alphanumeric mode. In the graphics mode, special symbols, 
diagrams and pictures can be displayed. 


The touch control panel is integrally packaged with the display unit, 
A 4-beam high by 16-beam wide grid can sense operator touch at any 
of 64 locations on the display panel. The touch panel/display pro- 
vides an **intelligent** terminal under microprocessor control. It 
can be used as an alphanumeric terminal with keyboard and display, 
as an alphanumeric display, or as a symbolic display which senses 
operator inputs for controlling processes and gathering data. 
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Dual RS-232 serial cominunlcation ports are controlled by an LSI-11 
Processor, Data rates are independently prograimnable between 50 and 
9600 baud. This provides compatibility with various computers, modems 
and other data communicative hardware. 

Communication to the terminal via its RS— 232 ports is similar to 
communication with a TTY except in the handling of lower case 
ASCII characters. The terminal does not display lower case char- 
acters* These characters are used as commands to the microprocessor 
in the terminal. 

The functions of these characters are: 

1. Terminal displays keyboard and responds as a TTY. 

2. Terminal responds as a TTY but does not display keyboard. 

3* Erases entire screen. 

A. Erases a zone. Must be followed by four parameters defining 
the area to be erased in X-Y coordinates. The coordinates 
are the* ends of a diagonal across the area. X values are 
from 0 to 255, while Y values are from 0 to 79. The 
coordinates are transferred in four binary bytes in the 
following order: XI, Yl, X2, Y2. 

5. Displays a text string. The command must be followed by a 
byte string consisting of: 

1 byte specifying the line number 0 to 7. 

1 byte specifying the beginning character position 
in the line. 

N Data bytes to be displayed. 

1 byte binary zero to terminate the string. 

6. Displays one dot. Command must be followed by 2 bytes 
defining the X and & coordinates of the dot. 
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7. 


8 . 

9. 

10 . 


Build a box on the display. The command must be followed by 
4 bytes defining the box in X-Y coordinates. The coordinates 
are the ends of a diagonal across the area. X values are 
from 0 to 255, while Y values are from 0 to 79. The coordinates 
are transferred in 4 binary bytes in the following order; 

XI, Yl, X2, Y2. 

Set the maximum number of lines allowed to display. The 
command must be followed by 1 byte with a value in the 
range of 1 to 8. 

Audio device generates 1 audible "Beep". 

Senses panel switches. Returns when 1 switch is actuated. 

Data returned is switch number 0 to 63. 


11. Same as above but waits 
3.0 TECHNICAL SPECIFICATION 

3.1 Touch Panel/Display; 

Type: 

Matrix Size: 

Character Size: 

Single Command Control: 

Cursor: 

Cross Grids: 


until finger is removed from switch. 

Owens Illinois Digivue Model 80-33 

Dot matrix plasma panel, alpha 
numberic information, graphics 

256 dots wide X 80 dots high 

5X7 dot matrix 

One dot/one character/entire 
display 

Display when used as an alpha 
numeric terminal 

High Intensity IR LED source/ 
detector 


Vertical: 16 parallel beams 

Horizontal; 4 parallel beams 

Light Beam Interrupt; 

Indicator: Audio tone 
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3.2 Central Processing Unit: 
Word Size: 

Memory: 

Memory Expansion: 
Software : 

3.3 I/O Interfaces 

Serial Asynchronous Data 
Interface 

3.4 Power Requirements: 

Size: 


DEC LSI-11 

16 bits 

4K PROM/ROM 

2 slots, 16K RAM; or 
8K ROM; or 4K each, 
ROM/RAM 

l/O Drivers, self test 
diagnostics 


RS-232, two ports 
programmable to 9600 BAUD 


115V rms, 60Hz, 10 
< 300W 

8-1/2" X 16" X 21" with 
enclosure covers removed. 
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